00000001:02000400:1.0F:1787758884.651193:0:2965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787758891.943643:0:3164:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787758892.894044:0:3225:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1583 MB/s 00000001:01000000:3.0:1787758893.144027:0:3225:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1819 MB/s 00000001:01000000:3.0:1787758893.393712:0:3225:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 9967 MB/s 00000020:02000000:2.0F:1787758893.630442:0:3259:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_104_g734b157 00000400:02000000:0.0F:1787758893.913229:0:3274:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.154@tcp [8/256/0/180] 00008000:02000000:0.0:1787758896.131520:0:3424:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787758911.424801:0:5227:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787758914.536791:0:5802:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787758914.536797:0:5802:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787758914.536919:0:5802:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000022df9a1a 00000080:02000400:3.0:1787758914.536930:0:5802:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787758914.539029:0:5802:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787758914.539037:0:5802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787758914.539061:0:5802:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000d748093d) 00000020:00000080:3.0:1787758914.539076:0:5802:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787758914.548054:0:5802:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787758914.548339:0:5802:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787758914.561673:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787758914.561698:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787758914.561709:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787758914.561739:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787758914.561753:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787758914.562062:0:5802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787758914.562070:0:5802:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787758914.562082:0:5802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa3b7f37aab2cf5f 00000020:01000004:3.0:1787758914.562091:0:5802:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787758914.562096:0:5802:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787758914.562101:0:5802:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000022df9a1a from MGS 00000020:01000004:3.0:1787758914.562106:0:5802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787758914.562117:0:5802:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000fec876ee) 00000020:00000080:3.0:1787758914.562127:0:5802:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787758914.562185:0:5802:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000022df9a1a from MGS, refs=2 00080000:01000000:3.0:1787758914.562189:0:5802:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787758914.562194:0:5802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa3b7f37aab2cf6d 00000100:00100000:3.0:1787758914.562302:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787758914.562426:0:5802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787758914.562430:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787758914.562749:0:5802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787758914.562755:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787758914.563331:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787758914.563452:0:5802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787758914.563456:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787758914.563891:0:5802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787758914.563896:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787758914.564136:0:5802:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787758914.564147:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787758914.564519:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758914.564522:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758914.564524:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758914.564687:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758914.564690:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758914.564691:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758914.564991:0:5802:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787758914.566735:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787758914.814792:0:5802:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 6983 MB/s 00000001:01000000:3.0:1787758915.064714:0:5802:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 8223 MB/s 00000001:01000000:3.0:1787758915.314947:0:5802:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1359 MB/s 00000001:01000000:3.0:1787758915.564923:0:5802:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1851 MB/s 00080000:10000000:3.0:1787758915.568327:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1787758915.575893:0:5802:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787758915.575909:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787758915.575911:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787758915.576412:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787758915.576434:0:5802:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787758915.576474:0:5802:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787758915.576702:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787758915.576740:0:5802:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787758915.577169:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787758915.577416:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787758915.577422:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787758915.579112:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787758915.579124:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787758915.579418:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787758915.579428:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1787758915.580170:0:5817:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1787758915.580220:0:5802:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787758915.580240:0:5802:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.154@tcp' 00000020:01000004:0.0:1787758915.580242:0:5802:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787758915.580289:0:5802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.154@tcp (typ=mgc) 00000020:00000080:0.0:1787758915.580309:0:5802:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.154@tcp (000000006657085b) 00000020:00000080:0.0:1787758915.580328:0:5802:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787758915.580458:0:5802:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000695ef31a@MGC192.168.201.154@tcp: add connection 192.168.201.154@tcp at head 00010000:00010000:0.0:1787758915.580684:0:5802:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.154@tcp-0 is initialized 00000040:01000000:0.0:1787758915.580690:0:5802:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.154@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787758915.581084:0:5818:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787758915.581134:0:5802:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.154@tcp (uuid 4ac8ab81-7a8c-4750-ad68-6c8860af0f55) 00000020:00000080:0.0:1787758915.581153:0:5802:0:(genops.c:1385:class_connect()) connect: client 4ac8ab81-7a8c-4750-ad68-6c8860af0f55, cookie 0xa3b7f37aab2cf7b 00000100:00080000:0.0:1787758915.581164:0:5802:0:(import.c:510:import_select_connection()) MGC192.168.201.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787758915.581169:0:5802:0:(import.c:624:import_select_connection()) MGC192.168.201.154@tcp: import 00000000695ef31a using connection 192.168.201.154@tcp/0@lo 00000100:00100000:0.0:1787758915.581205:0:5802:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d7576ea4 x1874601068986496/t0(0) o250->MGC192.168.201.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787758915.581228:0:5802:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4ac8ab81-7a8c-4750-ad68-6c8860af0f55->MGS 00000020:01000004:0.0:1787758915.581258:0:5802:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787758915.581262:0:5802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787758915.581273:0:5802:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000009fa49bfd) 00000020:00000080:0.0:1787758915.581290:0:5802:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787758915.581775:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7576ea4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3289:1874601068986496:0@lo:250: 00000100:00100000:3.0:1787758915.581860:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758915.582102:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068986496 00000100:00100000:3.0:1787758915.582109:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068986496 00000100:00100000:3.0:1787758915.582153:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787758915.582160:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a822b3a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3289:x1874601068986496:12345-0@lo:250: 00010000:00080000:3.0:1787758915.582193:0:5814:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 4ac8ab81-7a8c-4750-ad68-6c8860af0f55@0@lo t0 exp 0000000000000000 cur 65 last 0 00000020:00000080:3.0:1787758915.582235:0:5814:0:(genops.c:1385:class_connect()) connect: client 4ac8ab81-7a8c-4750-ad68-6c8860af0f55, cookie 0xa3b7f37aab2cf89 00000100:00080000:3.0:1787758915.582426:0:5814:0:(import.c:65:import_set_state_nolock()) 0000000009b73325 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787758915.582478:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a822b3a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:3289:x1874601068986496:12345-0@lo:250: Request processed in 319us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758915.582485:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787758915.582589:0:3289:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787758915.582597:0:3289:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.154@tcp: connect to target with instance 0 00000100:00080000:3.0:1787758915.582604:0:3289:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787758915.582608:0:3289:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787758915.582611:0:3289:0:(import.c:65:import_set_state_nolock()) 00000000695ef31a MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787758915.582660:0:3289:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787758915.582665:0:3289:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787758915.582670:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7576ea4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3289:1874601068986496:0@lo:250: 00000100:00100000:0.0:1787758915.589282:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787758915.589533:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787758915.589540:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787758915.590221:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787758915.590229:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787758915.590509:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787758915.590516:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787758915.591239:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787758915.591364:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787758915.591367:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787758915.591819:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787758915.591826:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:1.0:1787758915.612725:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758915.621417:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787758915.621655:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787758915.621668:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787758915.622601:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787758915.622608:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787758915.623201:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787758915.623321:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787758915.623326:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787758915.623807:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787758915.623818:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787758915.624453:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787758915.624604:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787758915.624610:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787758915.625675:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787758915.625684:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787758915.626267:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787758915.626426:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787758915.626430:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787758915.626888:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787758915.626895:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787758915.639724:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787758915.639932:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787758915.639945:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787758915.641302:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787758915.641311:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787758915.642259:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787758915.642266:0:5802:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787758915.643225:0:5802:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787758915.643249:0:5802:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787758915.643257:0:5802:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787758915.643410:0:5802:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.154@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787758915.643454:0:5802:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.154@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787758915.643458:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787758915.643460:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787758915.643462:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787758915.643463:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787758915.643464:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787758915.643466:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787758915.643468:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787758915.643470:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787758915.643471:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787758915.643472:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787758915.643474:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787758915.643475:0:5802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787758915.643477:0:5802:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787758915.643480:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787758915.643482:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787758915.643486:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787758915.643486:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787758915.643487:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787758915.643488:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787758915.643489:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787758915.643490:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787758915.643491:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787758915.643492:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787758915.643493:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787758915.643494:0:5802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787758915.643526:0:5802:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787758915.643544:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000511da472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068986624:0@lo:253: 00000100:00100000:0.0:1787758915.643648:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758915.643702:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068986624 00000100:00100000:0.0:1787758915.643711:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2a01ba1 going to sleep for 11 seconds 00000100:00100000:2.0:1787758915.643712:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068986624 00000100:00100000:2.0:1787758915.643771:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787758915.643780:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072fc856a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:5802:x1874601068986624:12345-0@lo:253: 20000000:01000000:2.0:1787758915.643844:0:5816:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787758915.643847:0:5816:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787758915.644017:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787758915.644053:0:5816:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787758915.644340:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787758915.645236:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787758915.645317:0:5816:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787758915.645320:0:5816:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787758915.645325:0:5816:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787758915.645328:0:5816:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787758915.645338:0:5816:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787758915.645409:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787758915.645534:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787758915.645543:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787758915.645576:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787758915.645601:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787758915.645670:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787758915.645754:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787758915.645761:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787758915.645790:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787758915.645795:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787758915.645831:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787758915.645836:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787758915.645852:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787758915.645879:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787758915.645904:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787758915.645908:0:5816:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787758915.645914:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787758915.646033:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787758915.646053:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787758915.646092:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787758915.646127:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787758915.646162:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787758915.646170:0:5816:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787758915.646223:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787758915.646230:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787758915.646274:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787758915.646308:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787758915.646339:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787758915.646350:0:5816:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787758915.646425:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787758915.646432:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787758915.646450:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787758915.646467:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787758915.646570:0:5816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787758915.646599:0:5816:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787758915.646605:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787758915.646863:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787758915.646979:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787758915.646993:0:5816:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.154@tcp for mdt 20000000:01000000:0.0:1787758915.646994:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.154@tcp (null) (null) (null) 00000040:00080000:0.0:1787758915.647013:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787758915.647018:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787758915.647060:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787758915.647069:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.154@tcp (null) (null) 00000040:00080000:0.0:1787758915.647133:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787758915.647143:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787758915.647176:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787758915.647223:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787758915.647271:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787758915.647274:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787758915.647279:0:5816:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787758915.647283:0:5816:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787758915.647474:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1787758915.647507:0:5816:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787758915.651931:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787758915.651964:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1787758915.652010:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1787758915.652024:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787758915.652026:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787758915.652028:0:5816:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787758915.652076:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787758915.652079:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787758915.652100:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787758915.652102:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787758915.652437:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787758915.652689:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787758915.652720:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787758915.652738:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1787758915.652745:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787758915.652749:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787758915.653044:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1787758915.653166:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1787758915.653208:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1787758915.653255:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:0.0:1787758915.653267:0:5816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787758915.653268:0:5816:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1787758915.653273:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787758915.653288:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009e9ea71d/0xa3b7f37aab2cf90 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.653301:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009e9ea71d/0xa3b7f37aab2cf90 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.653313:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009e9ea71d/0xa3b7f37aab2cf90 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.653316:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009e9ea71d/0xa3b7f37aab2cf90 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.653320:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009e9ea71d/0xa3b7f37aab2cf90 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.653324:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009e9ea71d/0xa3b7f37aab2cf90 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.653328:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009e9ea71d already unused, calling callback (000000006e110b00) 00010000:00010000:0.0:1787758915.653330:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009e9ea71d/0xa3b7f37aab2cf90 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.653334:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009e9ea71d/0xa3b7f37aab2cf90 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.653341:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009e9ea71d/0xa3b7f37aab2cf90 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.653347:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009e9ea71d/0xa3b7f37aab2cf90 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.653352:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009e9ea71d/0xa3b7f37aab2cf90 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787758915.653388:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787758915.751323:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072fc856a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:5802:x1874601068986624:12345-0@lo:253: Request processed in 107536us (107667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758915.751344:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000511da472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068986624:0@lo:253: 00000100:00100000:1.0:1787758915.751356:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:0.0:1787758915.751385:0:5802:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787758915.751389:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787758915.751392:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787758915.751393:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787758915.751394:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787758915.751396:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787758915.751398:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787758915.751399:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787758915.751401:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787758915.751403:0:5802:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787758915.751405:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787758915.751407:0:5802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787758915.751430:0:5802:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000022df9a1a from lustre-MDT0000 10000000:01000000:0.0:1787758915.751456:0:5802:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787758915.751459:0:5802:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787758915.751463:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99ccc74c3490 10000000:01000000:0.0:1787758915.751468:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787758915.751476:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99ccc74c3490 from 1 10000000:01000000:0.0:1787758915.751479:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787758915.751520:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 000000009e9ea71d/0xa3b7f37aab2cf97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.751530:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: 000000009e9ea71d/0xa3b7f37aab2cf97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.751539:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 000000009e9ea71d/0xa3b7f37aab2cf97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758915.751557:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000511da472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068986752:0@lo:101: 00000100:00100000:0.0:1787758915.751603:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758915.751686:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d441cb89 going to sleep for 11 seconds 00000100:00100000:3.0:1787758915.751748:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068986752 00000100:00100000:3.0:1787758915.751754:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068986752 00000100:00100000:3.0:1787758915.751795:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787758915.751814:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042a22793 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:5802:x1874601068986752:12345-0@lo:101: 00010000:00010000:3.0:1787758915.751829:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758915.751843:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b4870b20/0xa3b7f37aab2cf9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2cf97 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758915.751867:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b4870b20/0xa3b7f37aab2cf9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2cf97 expref: 6 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758915.751877:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b4870b20/0xa3b7f37aab2cf9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2cf97 expref: 6 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758915.751897:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b4870b20, rc 0) 00000100:00100000:3.0:1787758915.751970:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042a22793 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+6:5802:x1874601068986752:12345-0@lo:101: Request processed in 158us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758915.751976:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787758915.752026:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000511da472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068986752:0@lo:101: 00010000:00010000:0.0:1787758915.752046:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 000000009e9ea71d/0xa3b7f37aab2cf97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2cf9e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.752055:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 000000009e9ea71d/0xa3b7f37aab2cf97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2cf9e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758915.752095:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000511da472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068986880:0@lo:501: 00000100:00100000:0.0:1787758915.752117:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758915.752132:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d441cb89 going to sleep for 11 seconds 00000100:00100000:1.0:1787758915.752158:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068986880 00000100:00100000:1.0:1787758915.752163:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068986880 00000100:00100000:1.0:1787758915.752197:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787758915.752204:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad73fab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+6:5802:x1874601068986880:12345-0@lo:501: 00000100:00100000:1.0:1787758915.752380:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad73fab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+6:5802:x1874601068986880:12345-0@lo:501: Request processed in 177us (262us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787758915.752388:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787758915.752410:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000511da472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068986880:0@lo:501: 10000000:01000000:0.0:1787758915.752438:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787758915.752450:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: 000000009e9ea71d/0xa3b7f37aab2cf97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2cf9e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.752458:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: 000000009e9ea71d/0xa3b7f37aab2cf97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2cf9e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758915.752465:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ccd06d3800 10000000:01000000:0.0:1787758915.752469:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787758915.752472:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99ccd06d3800 10000000:01000000:0.0:1787758915.752474:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787758915.752477:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99ccd06d3800 from 1 10000000:01000000:0.0:1787758915.752480:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787758915.752491:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 00000000ee2221dd/0xa3b7f37aab2cfa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.752498:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: 00000000ee2221dd/0xa3b7f37aab2cfa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.752513:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 00000000ee2221dd/0xa3b7f37aab2cfa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758915.752523:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000511da472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068987008:0@lo:101: 00000100:00100000:0.0:1787758915.752546:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758915.752599:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d441cb89 going to sleep for 11 seconds 00000100:00100000:3.0:1787758915.752679:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068987008 00000100:00100000:3.0:1787758915.752683:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068987008 00000100:00100000:3.0:1787758915.752711:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787758915.752717:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bda9f474 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+6:5802:x1874601068987008:12345-0@lo:101: 00010000:00010000:3.0:1787758915.752723:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758915.752731:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a969a051/0xa3b7f37aab2cfac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2cfa5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758915.752743:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a969a051/0xa3b7f37aab2cfac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2cfa5 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758915.752750:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a969a051/0xa3b7f37aab2cfac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2cfa5 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758915.752756:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a969a051, rc 0) 00000100:00100000:3.0:1787758915.752783:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bda9f474 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+7:5802:x1874601068987008:12345-0@lo:101: Request processed in 66us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758915.752790:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787758915.752818:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000511da472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068987008:0@lo:101: 00010000:00010000:0.0:1787758915.752831:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 00000000ee2221dd/0xa3b7f37aab2cfa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2cfac expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.752840:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 00000000ee2221dd/0xa3b7f37aab2cfa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2cfac expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758915.752851:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787758915.752865:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: 00000000ee2221dd/0xa3b7f37aab2cfa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2cfac expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.752872:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: 00000000ee2221dd/0xa3b7f37aab2cfa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2cfac expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758915.752877:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787758915.752881:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787758915.752885:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99ccd06d3800 10000000:01000000:0.0:1787758915.752887:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787758915.752890:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787758915.752891:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787758915.752903:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 00000000f13d0ce2/0xa3b7f37aab2cfb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.752918:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: 00000000f13d0ce2/0xa3b7f37aab2cfb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.752924:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 00000000f13d0ce2/0xa3b7f37aab2cfb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758915.752935:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000511da472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068987136:0@lo:101: 00000100:00100000:0.0:1787758915.752961:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758915.752989:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d441cb89 going to sleep for 11 seconds 00000100:00100000:2.0:1787758915.753065:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068987136 00000100:00100000:2.0:1787758915.753071:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068987136 00000100:00100000:2.0:1787758915.753109:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787758915.753116:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d85ae23f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+7:5802:x1874601068987136:12345-0@lo:101: 00010000:00010000:2.0:1787758915.753124:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758915.753133:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000907c98ae/0xa3b7f37aab2cfba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2cfb3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.753157:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000907c98ae/0xa3b7f37aab2cfba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2cfb3 expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.753164:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000907c98ae/0xa3b7f37aab2cfba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2cfb3 expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.753169:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000907c98ae, rc 0) 00000100:00100000:2.0:1787758915.753196:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d85ae23f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+8:5802:x1874601068987136:12345-0@lo:101: Request processed in 81us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758915.753201:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787758915.753218:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000511da472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068987136:0@lo:101: 00010000:00010000:0.0:1787758915.753229:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 00000000f13d0ce2/0xa3b7f37aab2cfb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2cfba expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.753236:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 00000000f13d0ce2/0xa3b7f37aab2cfb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2cfba expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758915.753267:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000511da472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068987264:0@lo:501: 00000100:00100000:0.0:1787758915.753292:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758915.753314:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d441cb89 going to sleep for 11 seconds 00000100:00100000:3.0:1787758915.753366:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068987264 00000100:00100000:3.0:1787758915.753370:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068987264 00000100:00100000:3.0:1787758915.753433:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787758915.753440:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000783db9b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+8:5802:x1874601068987264:12345-0@lo:501: 00000100:00100000:3.0:1787758915.753597:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000783db9b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:5802:x1874601068987264:12345-0@lo:501: Request processed in 157us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758915.753611:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787758915.753646:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000511da472 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068987264:0@lo:501: 00000100:00100000:1.0:1787758915.753675:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041fe7283 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068987392:0@lo:503: 00000100:00100000:1.0:1787758915.753710:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758915.753735:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068987392 00000100:00100000:1.0:1787758915.753740:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 000000004fa5341e going to sleep for 11 seconds 00000100:00100000:3.0:1787758915.753740:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068987392 00000100:00100000:3.0:1787758915.753825:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787758915.753832:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000163cf29d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:5802:x1874601068987392:12345-0@lo:503: 00000100:00100000:3.0:1787758915.753996:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000163cf29d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:5802:x1874601068987392:12345-0@lo:503: Request processed in 165us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758915.754003:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787758915.754026:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041fe7283 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068987392:0@lo:503: 00000100:00100000:0.0:1787758915.754368:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024f3a704 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5844:1874601068987520:0@lo:502: 00000100:00100000:0.0:1787758915.754400:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758915.754416:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set 00000000238c0800 going to sleep for 11 seconds 00000100:00100000:2.0:1787758915.754431:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068987520 00000100:00100000:2.0:1787758915.754441:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068987520 00000100:00100000:2.0:1787758915.754461:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787758915.754469:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a1794c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:5844:x1874601068987520:12345-0@lo:502: 00000100:00100000:2.0:1787758915.754602:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a1794c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:5844:x1874601068987520:12345-0@lo:502: Request processed in 135us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758915.754631:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787758915.754646:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024f3a704 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5844:1874601068987520:0@lo:502: 00000020:01000000:0.0:1787758915.754674:0:5844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787758915.754687:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758915.754689:0:5844:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787758915.754699:0:5844:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787758915.754702:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787758915.754718:0:5844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000902c6c72) 00000020:00000080:0.0:1787758915.754739:0:5844:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787758915.754743:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787758915.754839:0:5844:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787758915.754845:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa3b7f37aab2cfc8 00000020:00000080:0.0:1787758915.755092:0:5844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787758915.755098:0:5844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787758915.755101:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758915.755103:0:5844:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787758915.755105:0:5844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787758915.755108:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758915.755109:0:5844:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787758915.755113:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787758915.755120:0:5844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000d5527461) 00000020:00000080:0.0:1787758915.755130:0:5844:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787758915.755133:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787758915.755135:0:5844:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787758915.755137:0:5844:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787758915.755144:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787758915.755187:0:5844:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000022df9a1a from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787758915.755208:0:5844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004488c29f) 00000020:00000080:0.0:1787758915.755217:0:5844:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787758915.755271:0:5844:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787758915.755276:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa3b7f37aab2cfdd 00000020:00000080:0.0:1787758915.755374:0:5844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787758915.755380:0:5844:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787758915.755386:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa3b7f37aab2cfe4 00080000:01000000:0.0:1787758915.755391:0:5844:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787758915.755394:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa3b7f37aab2cfeb 00080000:10000000:0.0:1787758915.755844:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787758915.756018:0:5844:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787758915.758265:0:5844:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1787758915.796768:0:5844:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1787758915.797141:0:5844:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1787758915.798859:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787758915.799027:0:5844:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787758915.806662:0:5844:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000009bc0dcb3) 00000020:00000080:1.0:1787758915.806684:0:5844:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787758915.806783:0:5844:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787758915.806791:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa3b7f37aab2cff9 00000020:00000080:1.0:1787758915.807100:0:5844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787758915.808286:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787758915.818534:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787758915.828694:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787758915.838516:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787758915.852126:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787758915.864233:0:5844:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787758915.874092:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa3b7f37aab2d000 00000020:00000080:0.0:1787758915.874367:0:5844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787758915.874382:0:5844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787758915.874389:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758915.874392:0:5844:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787758915.874395:0:5844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787758915.874402:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758915.874403:0:5844:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787758915.874407:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787758915.874450:0:5844:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787758915.874462:0:5844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787758915.874465:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758915.874466:0:5844:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787758915.874469:0:5844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787758915.874471:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758915.874472:0:5844:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787758915.874475:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787758915.874477:0:5844:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787758915.874533:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024f3a704 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5844:1874601068987648:0@lo:502: 00000100:00100000:0.0:1787758915.874651:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758915.874704:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068987648 00000100:00100000:3.0:1787758915.874711:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068987648 00000100:00100000:0.0:1787758915.874730:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set 000000004dad493c going to sleep for 11 seconds 00000100:00100000:3.0:1787758915.874760:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787758915.874771:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c20a73bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:5844:x1874601068987648:12345-0@lo:502: 00000100:00100000:3.0:1787758915.875144:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c20a73bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:5844:x1874601068987648:12345-0@lo:502: Request processed in 375us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758915.875152:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787758915.875197:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024f3a704 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5844:1874601068987648:0@lo:502: 00000020:01000000:0.0:1787758915.875226:0:5844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787758915.875231:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758915.875232:0:5844:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787758915.875235:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787758915.875327:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787758915.875357:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787758915.875378:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: 00000000f13d0ce2/0xa3b7f37aab2cfb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2cfba expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758915.875389:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: 00000000f13d0ce2/0xa3b7f37aab2cfb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2cfba expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758915.875398:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99ccd06d3800 from 1 10000000:01000000:1.0:1787758915.875401:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787758915.875429:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 00000000f8f694e8/0xa3b7f37aab2d007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758915.875436:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: 00000000f8f694e8/0xa3b7f37aab2d007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758915.875445:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 00000000f8f694e8/0xa3b7f37aab2d007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758915.875466:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041fe7283 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068987776:0@lo:101: 00000100:00100000:1.0:1787758915.875490:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758915.875513:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000069efa99 going to sleep for 11 seconds 00000100:00100000:2.0:1787758915.875534:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068987776 00000100:00100000:2.0:1787758915.875539:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068987776 00000100:00100000:2.0:1787758915.875564:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787758915.875569:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0c87bce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:5802:x1874601068987776:12345-0@lo:101: 00010000:00010000:2.0:1787758915.875576:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758915.875587:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000011560cf/0xa3b7f37aab2d00e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d007 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.875605:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000011560cf/0xa3b7f37aab2d00e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d007 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.875613:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000011560cf/0xa3b7f37aab2d00e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d007 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.875637:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000011560cf, rc 0) 00000100:00100000:2.0:1787758915.875670:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0c87bce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:5802:x1874601068987776:12345-0@lo:101: Request processed in 101us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758915.875676:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787758915.875699:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041fe7283 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068987776:0@lo:101: 00010000:00010000:1.0:1787758915.875710:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 00000000f8f694e8/0xa3b7f37aab2d007 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d00e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758915.875720:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 00000000f8f694e8/0xa3b7f37aab2d007 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d00e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758915.876135:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041fe7283 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068987904:0@lo:256: 00000100:00100000:1.0:1787758915.876185:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758915.876206:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000069efa99 going to sleep for 11 seconds 00000100:00100000:3.0:1787758915.876233:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068987904 00000100:00100000:3.0:1787758915.876239:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068987904 00000100:00100000:3.0:1787758915.876265:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787758915.876271:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000708c2f5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:5802:x1874601068987904:12345-0@lo:256: 20000000:01000000:3.0:1787758915.876286:0:5814:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787758915.876293:0:5814:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787758915.876364:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000708c2f5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:5802:x1874601068987904:12345-0@lo:256: Request processed in 93us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758915.876373:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787758915.876378:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041fe7283 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068987904:0@lo:256: 10000000:01000000:1.0:1787758915.876935:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787758915.876947:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: 00000000f8f694e8/0xa3b7f37aab2d007 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d00e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758915.876955:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: 00000000f8f694e8/0xa3b7f37aab2d007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d00e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758915.876962:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ccd06d3800 from 1 10000000:01000000:1.0:1787758915.876965:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787758915.876979:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 00000000d625fd9d/0xa3b7f37aab2d015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758915.876985:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: 00000000d625fd9d/0xa3b7f37aab2d015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758915.876992:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 00000000d625fd9d/0xa3b7f37aab2d015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758915.877002:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041fe7283 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068988032:0@lo:101: 00000100:00100000:1.0:1787758915.877027:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758915.877048:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000069efa99 going to sleep for 11 seconds 00000100:00100000:2.0:1787758915.877077:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068988032 00000100:00100000:2.0:1787758915.877083:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068988032 00000100:00100000:2.0:1787758915.877118:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787758915.877125:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007bad0f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:5802:x1874601068988032:12345-0@lo:101: 00010000:00010000:2.0:1787758915.877133:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758915.877150:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000450ffe94/0xa3b7f37aab2d01c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d015 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.877166:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000450ffe94/0xa3b7f37aab2d01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d015 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.877174:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000450ffe94/0xa3b7f37aab2d01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d015 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.877180:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000450ffe94, rc 0) 00000100:00100000:2.0:1787758915.877215:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007bad0f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:5802:x1874601068988032:12345-0@lo:101: Request processed in 91us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758915.877221:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787758915.877252:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041fe7283 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068988032:0@lo:101: 00010000:00010000:1.0:1787758915.877262:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 00000000d625fd9d/0xa3b7f37aab2d015 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d01c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758915.877270:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 00000000d625fd9d/0xa3b7f37aab2d015 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d01c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758915.877314:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041fe7283 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068988160:0@lo:501: 00000100:00100000:1.0:1787758915.877340:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758915.877363:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000069efa99 going to sleep for 11 seconds 00000100:00100000:3.0:1787758915.877534:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068988160 00000100:00100000:3.0:1787758915.877539:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068988160 00000100:00100000:3.0:1787758915.877566:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787758915.877580:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008411c1fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:5802:x1874601068988160:12345-0@lo:501: 00000100:00100000:3.0:1787758915.878189:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008411c1fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:5802:x1874601068988160:12345-0@lo:501: Request processed in 610us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758915.878196:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787758915.878244:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041fe7283 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068988160:0@lo:501: 00000100:00100000:1.0:1787758915.878275:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041fe7283 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068988288:0@lo:503: 00000100:00100000:1.0:1787758915.878311:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758915.878334:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000069efa99 going to sleep for 11 seconds 00000100:00100000:2.0:1787758915.878355:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068988288 00000100:00100000:2.0:1787758915.878360:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068988288 00000100:00100000:2.0:1787758915.878385:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787758915.878391:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091460ee2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:5802:x1874601068988288:12345-0@lo:503: 00000040:00080000:2.0:1787758915.878425:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787758915.878466:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091460ee2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:5802:x1874601068988288:12345-0@lo:503: Request processed in 76us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758915.878474:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787758915.878508:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041fe7283 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068988288:0@lo:503: 00000040:00080000:1.0:1787758915.879318:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787758915.879381:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787758915.879399:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787758915.879406:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: 00000000d625fd9d/0xa3b7f37aab2d015 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d01c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.879415:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: 00000000d625fd9d/0xa3b7f37aab2d015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d01c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758915.879457:0:5802:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787758915.879460:0:5802:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ccd06d3800 10000000:01000000:0.0:1787758915.879463:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ccd06d3800 10000000:01000000:0.0:1787758915.879468:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787758915.879473:0:5802:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ccd06d3800 from 1 10000000:01000000:0.0:1787758915.879475:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787758915.879491:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 0000000003d23734/0xa3b7f37aab2d023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.879498:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: 0000000003d23734/0xa3b7f37aab2d023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.879505:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 0000000003d23734/0xa3b7f37aab2d023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758915.879516:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024f3a704 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068988416:0@lo:101: 00000100:00100000:0.0:1787758915.879543:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758915.879569:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 0000000001dc8386 going to sleep for 11 seconds 00000100:00100000:3.0:1787758915.879583:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068988416 00000100:00100000:3.0:1787758915.879589:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068988416 00000100:00100000:3.0:1787758915.879644:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787758915.879653:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ceb14155 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:5802:x1874601068988416:12345-0@lo:101: 00010000:00010000:3.0:1787758915.879661:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758915.879671:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005551bb18/0xa3b7f37aab2d02a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d023 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758915.879689:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005551bb18/0xa3b7f37aab2d02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d023 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758915.879698:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005551bb18/0xa3b7f37aab2d02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d023 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758915.879705:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005551bb18, rc 0) 00000100:00100000:3.0:1787758915.879748:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ceb14155 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:5802:x1874601068988416:12345-0@lo:101: Request processed in 99us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758915.879756:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787758915.879772:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024f3a704 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068988416:0@lo:101: 00010000:00010000:0.0:1787758915.879784:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 0000000003d23734/0xa3b7f37aab2d023 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d02a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.879813:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 0000000003d23734/0xa3b7f37aab2d023 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d02a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758915.879848:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024f3a704 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068988544:0@lo:501: 00000100:00100000:0.0:1787758915.879870:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758915.879889:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 0000000001dc8386 going to sleep for 11 seconds 00000100:00100000:2.0:1787758915.879910:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068988544 00000100:00100000:2.0:1787758915.879916:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068988544 00000100:00100000:2.0:1787758915.879943:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787758915.879949:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5117c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:5802:x1874601068988544:12345-0@lo:501: 00000100:00100000:2.0:1787758915.880109:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5117c69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:5802:x1874601068988544:12345-0@lo:501: Request processed in 160us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758915.880118:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787758915.880127:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024f3a704 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068988544:0@lo:501: 00000100:00100000:0.0:1787758915.880164:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024f3a704 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068988672:0@lo:503: 00000100:00100000:0.0:1787758915.880192:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758915.880206:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 0000000001dc8386 going to sleep for 11 seconds 00000100:00100000:3.0:1787758915.880227:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068988672 00000100:00100000:3.0:1787758915.880232:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068988672 00000100:00100000:3.0:1787758915.880260:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787758915.880266:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007972c926 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:5802:x1874601068988672:12345-0@lo:503: 00000100:00100000:3.0:1787758915.880577:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007972c926 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:5802:x1874601068988672:12345-0@lo:503: Request processed in 311us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758915.880594:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787758915.880600:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024f3a704 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068988672:0@lo:503: 00000100:00100000:0.0:1787758915.880851:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024f3a704 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5849:1874601068988800:0@lo:502: 00000100:00100000:0.0:1787758915.880879:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758915.880899:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 000000006837f5b5 going to sleep for 11 seconds 00000100:00100000:2.0:1787758915.880921:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068988800 00000100:00100000:2.0:1787758915.880932:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068988800 00000100:00100000:2.0:1787758915.880957:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787758915.880964:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003040b7d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:5849:x1874601068988800:12345-0@lo:502: 00000100:00100000:2.0:1787758915.881141:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003040b7d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:5849:x1874601068988800:12345-0@lo:502: Request processed in 178us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758915.881149:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787758915.882060:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024f3a704 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5849:1874601068988800:0@lo:502: 00000020:01000004:0.0:1787758915.882117:0:5849:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787758915.882134:0:5849:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000002b7969e7) 00000020:00000080:0.0:1787758915.882164:0:5849:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787758915.882236:0:5849:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000022df9a1a from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787758915.882239:0:5849:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000022df9a1a from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787758915.882242:0:5849:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000022df9a1a 4 00010000:00080000:0.0:1787758915.882272:0:5849:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000076af5f35@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.154@tcp at head 00010000:00010000:0.0:1787758915.883881:0:5849:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787758915.884094:0:5849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787758915.884121:0:5849:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787758915.884136:0:5849:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa3b7f37aab2d038 00000100:00080000:0.0:1787758915.884146:0:5849:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787758915.884152:0:5849:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000076af5f35 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:0.0:1787758915.884182:0:5849:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000024f3a704 x1874601068988928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787758915.884206:0:5849:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787758915.884238:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024f3a704 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874601068988928:0@lo:38: 00000100:00100000:3.0:1787758915.884306:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758915.885363:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068988928 00000100:00100000:0.0:1787758915.885371:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068988928 00000100:00100000:0.0:1787758915.885412:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787758915.885421:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055853f08 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3289:x1874601068988928:12345-0@lo:38: 00000100:00100000:2.0:1787758915.885422:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787758915.885433:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787758915.885483:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055853f08 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3289:x1874601068988928:12345-0@lo:38: Request processed in 62us (1176us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787758915.885493:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787758915.885534:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787758915.885541:0:3289:0:(import.c:65:import_set_state_nolock()) 0000000076af5f35 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787758915.885546:0:3289:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787758915.885549:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024f3a704 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874601068988928:0@lo:38: 00000100:00100000:0.0:1787758915.885695:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c13bc573 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5849:1874601068989056:0@lo:502: 00000100:00100000:0.0:1787758915.885743:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758915.885774:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd131fad going to sleep for 11 seconds 00000100:00100000:2.0:1787758915.885849:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068989056 00000100:00100000:2.0:1787758915.885854:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068989056 00000100:00100000:2.0:1787758915.885904:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787758915.885913:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000837ac6dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:5849:x1874601068989056:12345-0@lo:502: 00000100:00100000:2.0:1787758915.886217:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000837ac6dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:5849:x1874601068989056:12345-0@lo:502: Request processed in 306us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758915.886226:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787758915.886235:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c13bc573 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5849:1874601068989056:0@lo:502: 00000040:00080000:0.0:1787758915.886265:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787758915.886336:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787758915.886362:0:5802:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787758915.886381:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: 0000000003d23734/0xa3b7f37aab2d023 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d02a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.886393:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: 0000000003d23734/0xa3b7f37aab2d023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d02a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787758915.886442:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787758915.886445:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787758915.886446:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787758915.886447:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787758915.886449:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787758915.886450:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787758915.886452:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787758915.886453:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787758915.886459:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787758915.886461:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787758915.886462:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787758915.886464:0:5802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787758915.886468:0:5802:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787758915.886470:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787758915.886472:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787758915.886473:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787758915.886474:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787758915.886475:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787758915.886476:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787758915.886478:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787758915.886479:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787758915.886479:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787758915.886480:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787758915.886481:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787758915.886482:0:5802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787758915.886499:0:5802:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787758915.886508:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006bb47e35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068989184:0@lo:253: 00000100:00100000:2.0:1787758915.886543:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758915.886568:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd884355 going to sleep for 11 seconds 00000100:00100000:3.0:1787758915.886588:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068989184 00000100:00100000:3.0:1787758915.886593:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068989184 00000100:00100000:3.0:1787758915.886655:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787758915.886663:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011a1e4ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:5802:x1874601068989184:12345-0@lo:253: 20000000:01000000:3.0:1787758915.886688:0:5816:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787758915.886703:0:5816:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787758915.902239:0:5816:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787758915.902298:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787758915.902349:0:5837:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787758915.902355:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787758915.902379:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001303494f/0xa3b7f37aab2d03f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.902402:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000011560cf/0xa3b7f37aab2d00e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d007 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.902411:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001303494f/0xa3b7f37aab2d03f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.902460:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000011560cf/0xa3b7f37aab2d00e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d007 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.902476:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000011560cf/0xa3b7f37aab2d00e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d007 expref: 12 pid: 5816 timeout: 216 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758915.902502:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a05976f3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5837:1874601068989312:0@lo:104: 00000100:00100000:2.0:1787758915.902591:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758915.902662:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068989312 00000100:00100000:0.0:1787758915.902671:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068989312 00000100:00100000:2.0:1787758915.902675:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4088237 going to sleep for 11 seconds 00000100:00100000:0.0:1787758915.902729:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787758915.902740:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f58a2095 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+3:5837:x1874601068989312:12345-0@lo:104: 00010000:00010000:0.0:1787758915.902755:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: 00000000f8f694e8/0xa3b7f37aab2d007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d00e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.902885:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787758915.902891:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f58a2095 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+3:5837:x1874601068989312:12345-0@lo:104: Request processed in 153us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758915.902909:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787758915.902911:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a05976f3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5837:1874601068989312:0@lo:104: 00010000:00010000:3.0:1787758915.902938:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001303494f/0xa3b7f37aab2d03f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.902998:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787758915.903005:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: 00000000f8f694e8/0xa3b7f37aab2d007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d00e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.903012:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f8f694e8 already unused, calling callback (00000000c496ff98) 10000000:00010000:2.0:1787758915.903016:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: 00000000f8f694e8/0xa3b7f37aab2d007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d00e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.903024:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: 00000000f8f694e8/0xa3b7f37aab2d007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d00e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787758915.903030:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: 00000000f8f694e8/0xa3b7f37aab2d007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d00e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758915.903098:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787758915.903138:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: 00000000f8f694e8/0xa3b7f37aab2d007 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d00e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.903145:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787758915.903171:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: 00000000f8f694e8/0xa3b7f37aab2d007 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d00e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.903177:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: 00000000f8f694e8/0xa3b7f37aab2d007 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d00e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.903196:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758915.903204:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758915.903206:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758915.903247:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000105fde28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3291:1874601068989440:0@lo:103: 00000100:00100000:1.0:1787758915.903278:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758915.903315:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068989440 00000100:00100000:2.0:1787758915.903321:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068989440 00010000:00010000:2.0:1787758915.903345:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000011560cf/0xa3b7f37aab2d00e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d007 expref: 13 pid: 5816 timeout: 216 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758915.903561:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787758915.903570:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041fe7283 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:3291:x1874601068989440:12345-0@lo:103: 00010000:00010000:2.0:1787758915.903582:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787758915.903587:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000011560cf/0xa3b7f37aab2d00e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d007 expref: 13 pid: 5816 timeout: 216 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.903598:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000011560cf/0xa3b7f37aab2d00e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d007 expref: 13 pid: 5816 timeout: 216 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.903609:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000011560cf/0xa3b7f37aab2d00e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d007 expref: 13 pid: 5816 timeout: 216 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.903643:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001303494f/0xa3b7f37aab2d03f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.903651:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001303494f/0xa3b7f37aab2d03f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787758915.903663:0:5806:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001310059s 00010000:00010000:2.0:1787758915.903666:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001303494f/0xa3b7f37aab2d03f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.903672:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001303494f/0xa3b7f37aab2d03f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.903688:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001303494f/0xa3b7f37aab2d03f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.903694:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001303494f/0xa3b7f37aab2d03f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.903699:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001303494f already unused, calling callback (000000006e110b00) 00010000:00010000:2.0:1787758915.903702:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001303494f/0xa3b7f37aab2d03f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.903709:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001303494f/0xa3b7f37aab2d03f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.903725:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001303494f/0xa3b7f37aab2d03f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.903730:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001303494f/0xa3b7f37aab2d03f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758915.903736:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787758915.903742:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001303494f/0xa3b7f37aab2d03f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758915.903749:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001303494f/0xa3b7f37aab2d03f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758915.903778:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041fe7283 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:3291:x1874601068989440:12345-0@lo:103: Request processed in 211us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758915.903785:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787758915.903839:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000105fde28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3291:1874601068989440:0@lo:103: 00000100:00100000:3.0:1787758915.907203:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011a1e4ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:5802:x1874601068989184:12345-0@lo:253: Request processed in 20534us (20652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758915.907221:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787758915.907314:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006bb47e35 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5802:1874601068989184:0@lo:253: 10000000:01000000:2.0:1787758915.907330:0:5802:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787758915.907333:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787758915.907335:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787758915.907336:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787758915.907338:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787758915.907339:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787758915.907340:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787758915.907342:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787758915.907343:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787758915.907345:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787758915.907358:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787758915.907360:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787758915.907362:0:5802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787758915.907376:0:5802:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787758915.911106:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787758915.911508:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787758915.911731:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787758915.911905:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787758915.912083:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787758915.912289:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787758915.913051:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787758915.913222:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787758915.913400:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787758915.913556:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787758915.913788:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787758915.913963:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1787758915.929944:0:5802:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787758915.943848:0:5802:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787758915.943858:0:5855:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787758915.943864:0:5855:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787758915.944175:0:5856:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787758915.948986:0:5802:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787758915.949354:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787758915.949784:0:5802:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787758915.949791:0:5802:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787758915.950077:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787758915.951415:0:5802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787758915.954288:0:5802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787758915.954358:0:5802:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787758915.954653:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787758915.954991:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1787758915.956604:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787758915.958593:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787758915.958942:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787758915.959185:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787758915.959533:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787758915.959742:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787758915.959943:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787758915.960136:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787758915.960456:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787758915.960682:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787758915.960907:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787758915.961112:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787758915.961291:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000040:00080000:0.0:1787758915.961640:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:1.0:1787758915.961657:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787758915.961900:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787758915.962470:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787758915.963318:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787758915.963786:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787758915.964086:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787758915.964351:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787758915.964641:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787758915.965033:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787758915.965461:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787758915.965924:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787758915.966241:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787758915.966532:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787758915.966874:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787758915.967122:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787758915.967497:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787758915.967885:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787758915.968167:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787758915.968425:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787758915.968772:0:5802:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787758915.980265:0:5856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787758915.980341:0:5856:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787758915.980346:0:5856:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1787758915.993597:0:5802:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787758915.993670:0:5802:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbf6301db7988 00100000:10000000:1.0:1787758915.993681:0:5802:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787758915.994047:0:5802:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787758915.994067:0:5802:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.154@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787758915.994086:0:5802:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1787758915.994126:0:5802:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787758916.636739:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787758917.363472:0:6099:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787758917.660792:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758918.684736:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758919.708780:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787758919.730015:0:6300:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc2804f770 20000000:00000080:2.0:1787758919.730031:0:6300:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ccf4f12c00 uarg=0000000000000000 20000000:01000000:2.0:1787758919.731142:0:6300:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787758919.731149:0:6300:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787758919.731154:0:6300:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787758919.732531:0:6300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787758919.732541:0:6300:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787758919.735331:0:6300:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787758919.735557:0:6300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787758919.735611:0:6300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787758919.735698:0:6300:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787758919.735714:0:6300:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787758919.735746:0:6300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000af437f58/0xa3b7f37aab2d046 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758919.735764:0:6300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000450ffe94/0xa3b7f37aab2d01c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d015 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758919.735772:0:6300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000af437f58/0xa3b7f37aab2d046 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758919.735815:0:6300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000450ffe94/0xa3b7f37aab2d01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d015 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758919.735828:0:6300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000450ffe94/0xa3b7f37aab2d01c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d015 expref: 10 pid: 5816 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758919.735841:0:6300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a026771 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6300:1874601068989568:0@lo:104: 00000100:00100000:2.0:1787758919.735904:0:6300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758919.735962:0:6300:0:(client.c:2715:ptlrpc_set_wait()) set 0000000062c417f5 going to sleep for 11 seconds 00000100:00100000:3.0:1787758919.735967:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068989568 00000100:00100000:3.0:1787758919.735976:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068989568 00000100:00100000:3.0:1787758919.736021:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787758919.736036:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a02e8bd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+3:6300:x1874601068989568:12345-0@lo:104: 00010000:00010000:3.0:1787758919.736048:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: 00000000d625fd9d/0xa3b7f37aab2d015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d01c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758919.736102:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787758919.736112:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a02e8bd1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+3:6300:x1874601068989568:12345-0@lo:104: Request processed in 80us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758919.736120:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787758919.736126:0:6300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a026771 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6300:1874601068989568:0@lo:104: 00010000:00010000:1.0:1787758919.736131:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787758919.736137:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: 00000000d625fd9d/0xa3b7f37aab2d015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d01c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758919.736147:0:6300:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000af437f58/0xa3b7f37aab2d046 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758919.736152:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d625fd9d already unused, calling callback (00000000c496ff98) 10000000:00010000:1.0:1787758919.736156:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: 00000000d625fd9d/0xa3b7f37aab2d015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d01c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758919.736163:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: 00000000d625fd9d/0xa3b7f37aab2d015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d01c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787758919.736168:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: 00000000d625fd9d/0xa3b7f37aab2d015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d01c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758919.736172:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787758919.736197:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: 00000000d625fd9d/0xa3b7f37aab2d015 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d01c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758919.736202:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787758919.736214:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: 00000000d625fd9d/0xa3b7f37aab2d015 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d01c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758919.736227:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: 00000000d625fd9d/0xa3b7f37aab2d015 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d01c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758919.736238:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758919.736239:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758919.736239:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787758919.736341:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008aa51b51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601068989696:0@lo:103: 00000100:00100000:2.0:1787758919.736370:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758919.736409:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068989696 00000100:00100000:1.0:1787758919.736412:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068989696 00010000:00010000:1.0:1787758919.736429:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000450ffe94/0xa3b7f37aab2d01c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d015 expref: 11 pid: 5816 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758919.736462:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787758919.736468:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a026771 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:3292:x1874601068989696:12345-0@lo:103: 00010000:00010000:1.0:1787758919.736475:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787758919.736478:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000450ffe94/0xa3b7f37aab2d01c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d015 expref: 11 pid: 5816 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758919.736492:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000450ffe94/0xa3b7f37aab2d01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d015 expref: 11 pid: 5816 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758919.736504:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000450ffe94/0xa3b7f37aab2d01c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d015 expref: 11 pid: 5816 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758919.736515:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000af437f58/0xa3b7f37aab2d046 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758919.736523:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000af437f58/0xa3b7f37aab2d046 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758919.736534:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000af437f58/0xa3b7f37aab2d046 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758919.736543:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000af437f58/0xa3b7f37aab2d046 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758919.736549:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000af437f58/0xa3b7f37aab2d046 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758919.736555:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000af437f58/0xa3b7f37aab2d046 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758919.736561:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000af437f58 already unused, calling callback (000000006e110b00) 00010000:00010000:1.0:1787758919.736564:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000af437f58/0xa3b7f37aab2d046 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758919.736571:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000af437f58/0xa3b7f37aab2d046 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758919.736598:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000af437f58/0xa3b7f37aab2d046 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758919.736605:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787758919.736653:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a026771 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:3292:x1874601068989696:12345-0@lo:103: Request processed in 186us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758919.736658:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787758919.736668:0:6300:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000af437f58/0xa3b7f37aab2d046 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758919.736678:0:6300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000af437f58/0xa3b7f37aab2d046 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758919.736684:0:6300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000af437f58/0xa3b7f37aab2d046 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758919.736685:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008aa51b51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601068989696:0@lo:103: 00010000:00010000:0.0:1787758920.733679:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787758921.373718:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787758921.373725:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787758921.373729:0:8:0:(import.c:65:import_set_state_nolock()) 0000000076af5f35 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787758921.373742:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000076af5f35 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:2.0:1787758921.373769:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f98fe034 x1874601068989952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787758921.373809:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f98fe034 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874601068989952:0@lo:38: 00000100:00100000:1.0:1787758921.373858:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bd71a2cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3293:1874601068989824:0@lo:400: 00000100:00100000:2.0:1787758921.373903:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758921.373933:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758921.373934:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068989952 00000100:00100000:0.0:1787758921.373943:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068989952 00000100:00100000:2.0:1787758921.373977:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068989824 00000100:00100000:0.0:1787758921.373982:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787758921.373983:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068989824 00000100:00100000:0.0:1787758921.373997:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010129c92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3289:x1874601068989952:12345-0@lo:38: 00010000:00080000:0.0:1787758921.374021:0:5823:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 71 last 0 00000100:00100000:2.0:1787758921.374024:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787758921.374035:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cec0e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:3293:x1874601068989824:12345-0@lo:400: 00000020:00000080:0.0:1787758921.374067:0:5823:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa3b7f37aab2d04d 00000100:00100000:2.0:1787758921.374095:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cec0e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:3293:x1874601068989824:12345-0@lo:400: Request processed in 62us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758921.374107:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000004:00100000:0.0:1787758921.374108:0:5823:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1787758921.374200:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bd71a2cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3293:1874601068989824:0@lo:400: 00000100:00080000:0.0:1787758921.374256:0:5823:0:(import.c:65:import_set_state_nolock()) 000000000401b426 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787758921.374302:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010129c92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1874601068989952:12345-0@lo:38: Request processed in 306us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758921.374310:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787758921.374344:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f98fe034 x1874601068989952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787758931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787758921.374357:0:3289:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787758921.374363:0:3289:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787758921.374366:0:3289:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787758921.374368:0:3289:0:(import.c:65:import_set_state_nolock()) 0000000076af5f35 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787758921.374373:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f98fe034 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3289:1874601068989952:0@lo:38: 00010000:00010000:3.0:1787758921.756785:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787758921.819098:0:6666:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787758921.819107:0:6666:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787758921.819252:0:6666:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005bdc8fc1 00000020:01000004:1.0:1787758921.819274:0:6666:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787758921.819287:0:6666:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787758921.819301:0:6666:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000007f435eef) 00000020:00000080:1.0:1787758921.819317:0:6666:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787758921.828432:0:6666:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787758921.828740:0:6666:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787758921.842074:0:6666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787758921.844753:0:6666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787758921.844773:0:6666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787758921.844806:0:6666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787758921.844822:0:6666:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787758921.845130:0:6666:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787758921.845143:0:6666:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787758921.845155:0:6666:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa3b7f37aab2d05b 00000020:01000004:3.0:1787758921.845164:0:6666:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787758921.845186:0:6666:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787758921.845189:0:6666:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787758921.845194:0:6666:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787758921.845197:0:6666:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787758921.845208:0:6666:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000000516fd19) 00000020:00000080:3.0:1787758921.845224:0:6666:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787758921.846562:0:6666:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787758921.846790:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787758921.846796:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787758921.847288:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787758921.847297:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787758921.847514:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787758921.847522:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787758921.849098:0:6666:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787758921.849305:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787758921.849312:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787758921.849663:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787758921.849670:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787758921.863174:0:6666:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787758921.863386:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787758921.863393:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787758921.864911:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787758921.864921:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787758921.865909:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787758921.865917:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787758921.868271:0:6666:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787758921.868410:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787758921.868415:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787758921.868819:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787758921.868827:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787758921.895141:0:6666:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787758921.895392:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787758921.895400:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787758921.896888:0:6666:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787758921.896900:0:6666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787758921.897243:0:6666:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787758921.897272:0:6666:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787758921.897280:0:6666:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787758921.909802:0:6666:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787758921.909839:0:6666:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.154@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787758921.909843:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787758921.909844:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787758921.909845:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787758921.909846:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787758921.909847:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787758921.909847:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787758921.909849:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787758921.909850:0:6666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787758921.909851:0:6666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787758921.909852:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787758921.909853:0:6666:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787758921.909856:0:6666:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787758921.909857:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787758921.909858:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787758921.909858:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787758921.909859:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787758921.909859:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787758921.909860:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787758921.909860:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787758921.909861:0:6666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787758921.909861:0:6666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787758921.909862:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787758921.909863:0:6666:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787758921.909890:0:6666:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787758921.909908:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006dc4172f pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068990080:0@lo:253: 00000100:00100000:2.0:1787758921.909981:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758921.910031:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc5b70c6 going to sleep for 11 seconds 00000100:00100000:3.0:1787758921.910043:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068990080 00000100:00100000:3.0:1787758921.910053:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068990080 00000100:00100000:3.0:1787758921.910115:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787758921.910126:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c573fe7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:6666:x1874601068990080:12345-0@lo:253: 20000000:01000000:3.0:1787758921.910162:0:5816:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787758921.910167:0:5816:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1787758921.910172:0:5816:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1787758921.910175:0:5816:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1787758921.912018:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787758921.912208:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1787758921.912222:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1787758921.912260:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1787758921.912268:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1787758921.912298:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1787758921.912347:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1787758921.912746:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787758921.912766:0:5816:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.154@tcp 20000000:01000000:3.0:1787758921.912768:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.154@tcp (null) (null) (null) 00000040:00080000:3.0:1787758921.912802:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787758921.912811:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787758921.912856:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787758921.912864:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.154@tcp (null) (null) 00000040:00080000:3.0:1787758921.912896:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787758921.912906:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787758921.912937:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787758921.912988:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1787758921.913784:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787758921.913805:0:5816:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.154@tcp 20000000:01000000:3.0:1787758921.913807:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.154@tcp (null) (null) (null) 00000040:00080000:3.0:1787758921.913842:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787758921.913850:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787758921.913881:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787758921.913889:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.154@tcp (null) (null) 00000040:00080000:3.0:1787758921.913933:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787758921.913941:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787758921.913983:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787758921.914023:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787758921.914039:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787758921.914042:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787758921.914046:0:5816:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787758921.914058:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787758921.914062:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787758921.914095:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787758921.914097:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787758921.914531:0:6681:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787758921.914581:0:6681:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787758921.914656:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787758921.914871:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787758921.914911:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787758921.914956:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1787758921.914967:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787758921.914968:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787758921.915212:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787758921.915312:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1787758921.915331:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1787758921.915357:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1787758921.915363:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787758921.915364:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787758921.915716:0:6683:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1787758921.915756:0:6683:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1787758921.915805:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787758921.915936:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787758921.915956:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787758921.915990:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787758921.915999:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787758921.916000:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787758921.916007:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787758921.916028:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bc605be5/0xa3b7f37aab2d069 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.916042:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b4870b20/0xa3b7f37aab2cf9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2cf97 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.916047:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000907c98ae/0xa3b7f37aab2cfba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2cfb3 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.916051:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005551bb18/0xa3b7f37aab2d02a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d023 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.916054:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bc605be5/0xa3b7f37aab2d069 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.916086:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005551bb18/0xa3b7f37aab2d02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d023 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.916095:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005551bb18/0xa3b7f37aab2d02a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d023 expref: 10 pid: 5814 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758921.916105:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e7ed62fb pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1874601068990208:0@lo:104: 00000100:00100000:3.0:1787758921.916153:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787758921.916196:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000907c98ae/0xa3b7f37aab2cfba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2cfb3 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.916201:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000907c98ae/0xa3b7f37aab2cfba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2cfb3 expref: 10 pid: 5816 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758921.916208:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014357f19 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1874601068990336:0@lo:104: 00000100:00100000:2.0:1787758921.916215:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068990208 00000100:00100000:2.0:1787758921.916223:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068990208 00000100:00100000:3.0:1787758921.916227:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787758921.916256:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b4870b20/0xa3b7f37aab2cf9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2cf97 expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.916263:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b4870b20/0xa3b7f37aab2cf9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2cf97 expref: 10 pid: 5814 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758921.916264:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068990336 00000100:00100000:2.0:1787758921.916268:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068990336 00000100:00100000:0.0:1787758921.916272:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787758921.916277:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f0740bc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1874601068990464:0@lo:104: 00000100:00100000:0.0:1787758921.916284:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028e98932 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+4:5816:x1874601068990208:12345-0@lo:104: 00000100:00100000:3.0:1787758921.916296:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787758921.916297:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: 0000000003d23734/0xa3b7f37aab2d023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d02a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758921.916305:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e5f065cb going to sleep for 11 seconds 00000100:00100000:2.0:1787758921.916319:0:5804:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787758921.916327:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1787758921.916370:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787758921.916375:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028e98932 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+4:5816:x1874601068990208:12345-0@lo:104: Request processed in 96us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758921.916382:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787758921.916383:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e7ed62fb pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1874601068990208:0@lo:104: 00000100:00100000:0.0:1787758921.916404:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068990464 00010000:00010000:2.0:1787758921.916404:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787758921.916409:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068990464 00010000:00010000:2.0:1787758921.916412:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: 0000000003d23734/0xa3b7f37aab2d023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d02a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758921.916423:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787758921.916429:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014570b0f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+4:5816:x1874601068990336:12345-0@lo:104: 00010000:00010000:0.0:1787758921.916438:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: 00000000f13d0ce2/0xa3b7f37aab2cfb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2cfba expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.916441:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000003d23734 already unused, calling callback (00000000c496ff98) 10000000:00010000:2.0:1787758921.916446:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: 0000000003d23734/0xa3b7f37aab2d023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d02a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.916456:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: 0000000003d23734/0xa3b7f37aab2d023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d02a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787758921.916464:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: 0000000003d23734/0xa3b7f37aab2d023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d02a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758921.916470:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787758921.916477:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787758921.916482:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014570b0f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+4:5816:x1874601068990336:12345-0@lo:104: Request processed in 54us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758921.916491:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787758921.916508:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014357f19 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1874601068990336:0@lo:104: 00000100:00100000:0.0:1787758921.916510:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787758921.916510:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: 0000000003d23734/0xa3b7f37aab2d023 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d02a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758921.916520:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d322675 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+3:5816:x1874601068990464:12345-0@lo:104: 00010000:00010000:2.0:1787758921.916520:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787758921.916528:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: 000000009e9ea71d/0xa3b7f37aab2cf97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2cf9e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.916569:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1787758921.916569:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: 0000000003d23734/0xa3b7f37aab2d023 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d02a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758921.916579:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d322675 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+3:5816:x1874601068990464:12345-0@lo:104: Request processed in 60us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758921.916582:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f0740bc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5816:1874601068990464:0@lo:104: 00010000:00010000:2.0:1787758921.916583:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: 0000000003d23734/0xa3b7f37aab2d023 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d02a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758921.916584:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787758921.916603:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787758921.916648:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787758921.916651:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: 00000000f13d0ce2/0xa3b7f37aab2cfb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2cfba expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.916657:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f13d0ce2 already unused, calling callback (00000000c496ff98) 10000000:00010000:2.0:1787758921.916660:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: 00000000f13d0ce2/0xa3b7f37aab2cfb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2cfba expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.916665:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787758921.916671:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006bb47e35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3291:1874601068990592:0@lo:103: 00010000:00010000:3.0:1787758921.916675:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bc605be5/0xa3b7f37aab2d069 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.916702:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: 00000000f13d0ce2/0xa3b7f37aab2cfb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2cfba expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787758921.916714:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: 00000000f13d0ce2/0xa3b7f37aab2cfb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2cfba expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758921.916719:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787758921.916741:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: 00000000f13d0ce2/0xa3b7f37aab2cfb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2cfba expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.916747:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787758921.916766:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: 00000000f13d0ce2/0xa3b7f37aab2cfb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2cfba expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.916773:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: 00000000f13d0ce2/0xa3b7f37aab2cfb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2cfba expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758921.916774:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787758921.916785:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758921.916788:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000080198d9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601068990720:0@lo:103: 00010000:00010000:2.0:1787758921.916801:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758921.916807:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758921.916809:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758921.916839:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068990592 00000100:00100000:0.0:1787758921.916840:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758921.916846:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068990592 00010000:00010000:3.0:1787758921.916877:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005551bb18/0xa3b7f37aab2d02a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d023 expref: 11 pid: 5814 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758921.916882:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068990720 00000100:00100000:2.0:1787758921.916896:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068990720 00010000:00010000:2.0:1787758921.916918:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000907c98ae/0xa3b7f37aab2cfba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2cfb3 expref: 12 pid: 5816 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758921.916921:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787758921.916924:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758921.916931:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: 000000009e9ea71d/0xa3b7f37aab2cf97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2cf9e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758921.916935:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074400428 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:3291:x1874601068990592:12345-0@lo:103: 00010000:00010000:0.0:1787758921.916941:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009e9ea71d already unused, calling callback (00000000c496ff98) 10000000:00010000:0.0:1787758921.916945:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: 000000009e9ea71d/0xa3b7f37aab2cf97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2cf9e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758921.916945:0:5807:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1787758921.916948:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787758921.916956:0:5807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1787758921.916957:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005551bb18/0xa3b7f37aab2d02a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d023 expref: 12 pid: 5814 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.916959:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: 000000009e9ea71d/0xa3b7f37aab2cf97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2cf9e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758921.916976:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: 000000009e9ea71d/0xa3b7f37aab2cf97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2cf9e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.916980:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005551bb18/0xa3b7f37aab2d02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d023 expref: 12 pid: 5814 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758921.916988:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787758921.917000:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005551bb18/0xa3b7f37aab2d02a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d023 expref: 12 pid: 5814 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.917026:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: 000000009e9ea71d/0xa3b7f37aab2cf97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2cf9e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.917026:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787758921.917034:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787758921.917041:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758921.917050:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758921.917059:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: 000000009e9ea71d/0xa3b7f37aab2cf97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2cf9e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.917063:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: 000000009e9ea71d/0xa3b7f37aab2cf97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2cf9e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758921.917068:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000007e024df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601068990848:0@lo:103: 00000100:00100000:3.0:1787758921.917074:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074400428 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:3291:x1874601068990592:12345-0@lo:103: Request processed in 141us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758921.917082:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787758921.917083:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758921.917086:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758921.917089:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758921.917103:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787758921.917112:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002928652e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:3290:x1874601068990720:12345-0@lo:103: 00000100:00100000:2.0:1787758921.917119:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787758921.917126:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787758921.917131:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000907c98ae/0xa3b7f37aab2cfba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2cfb3 expref: 10 pid: 5816 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.917143:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000907c98ae/0xa3b7f37aab2cfba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2cfb3 expref: 10 pid: 5816 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.917157:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000907c98ae/0xa3b7f37aab2cfba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2cfb3 expref: 10 pid: 5816 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758921.917163:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006bb47e35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3291:1874601068990592:0@lo:103: 00010000:00010000:3.0:1787758921.917183:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787758921.917201:0:5808:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787758921.917207:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068990848 00000100:00100000:0.0:1787758921.917210:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068990848 00010000:00010000:0.0:1787758921.917222:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b4870b20/0xa3b7f37aab2cf9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2cf97 expref: 10 pid: 5814 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758921.917226:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002928652e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:3290:x1874601068990720:12345-0@lo:103: Request processed in 112us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758921.917239:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787758921.917258:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787758921.917267:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000105fde28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:3292:x1874601068990848:12345-0@lo:103: 00010000:00010000:0.0:1787758921.917274:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787758921.917278:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b4870b20/0xa3b7f37aab2cf9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2cf97 expref: 9 pid: 5814 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.917284:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b4870b20/0xa3b7f37aab2cf9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2cf97 expref: 9 pid: 5814 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.917294:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b4870b20/0xa3b7f37aab2cf9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2cf97 expref: 9 pid: 5814 timeout: 222 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.917306:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bc605be5/0xa3b7f37aab2d069 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.917311:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bc605be5/0xa3b7f37aab2d069 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.917321:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bc605be5/0xa3b7f37aab2d069 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758921.917322:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000080198d9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601068990720:0@lo:103: 00010000:00010000:0.0:1787758921.917341:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bc605be5/0xa3b7f37aab2d069 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.917346:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bc605be5/0xa3b7f37aab2d069 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.917355:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bc605be5/0xa3b7f37aab2d069 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.917358:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bc605be5 already unused, calling callback (000000006e110b00) 00010000:00010000:0.0:1787758921.917361:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bc605be5/0xa3b7f37aab2d069 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.917365:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bc605be5/0xa3b7f37aab2d069 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.917377:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bc605be5/0xa3b7f37aab2d069 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.917383:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787758921.917397:0:5816:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bc605be5/0xa3b7f37aab2d069 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.917403:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bc605be5/0xa3b7f37aab2d069 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.917407:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bc605be5/0xa3b7f37aab2d069 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758921.917411:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000105fde28 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+8:3292:x1874601068990848:12345-0@lo:103: Request processed in 145us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758921.917422:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787758921.917435:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000007e024df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601068990848:0@lo:103: 20000000:01000000:3.0:1787758921.917439:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787758921.929917:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c573fe7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+7:6666:x1874601068990080:12345-0@lo:253: Request processed in 19789us (19930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758921.929930:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787758921.929942:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006dc4172f pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068990080:0@lo:253: 10000000:01000000:2.0:1787758921.929962:0:6666:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787758921.929966:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787758921.929968:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787758921.929970:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787758921.929971:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787758921.929973:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787758921.929974:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787758921.929976:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787758921.929977:0:6666:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787758921.929979:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787758921.929981:0:6666:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787758921.930001:0:6666:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005bdc8fc1 from lustre-OST0000 10000000:01000000:2.0:1787758921.930024:0:6666:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787758921.930027:0:6666:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787758921.930034:0:6666:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99ccc74c3490 local copy 10000000:01000000:2.0:1787758921.930038:0:6666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787758921.930074:0:6666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 00000000af437f58/0xa3b7f37aab2d070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.930084:0:6666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.154@tcp lock: 00000000af437f58/0xa3b7f37aab2d070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.930092:0:6666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 00000000af437f58/0xa3b7f37aab2d070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758921.930108:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006dc4172f pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068990976:0@lo:101: 00000100:00100000:2.0:1787758921.930143:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758921.930180:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068990976 00000100:00100000:0.0:1787758921.930186:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068990976 00000100:00100000:2.0:1787758921.930197:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a34f241c going to sleep for 11 seconds 00000100:00100000:0.0:1787758921.930227:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787758921.930233:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2f1a3ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+7:6666:x1874601068990976:12345-0@lo:101: 00010000:00010000:0.0:1787758921.930246:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758921.930256:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009e9ea71d/0xa3b7f37aab2d077 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d070 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.930275:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009e9ea71d/0xa3b7f37aab2d077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d070 expref: 8 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.930282:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009e9ea71d/0xa3b7f37aab2d077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d070 expref: 8 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.930296:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009e9ea71d, rc 0) 00000100:00100000:0.0:1787758921.930323:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2f1a3ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+8:6666:x1874601068990976:12345-0@lo:101: Request processed in 90us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758921.930327:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787758921.930355:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006dc4172f pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068990976:0@lo:101: 00010000:00010000:2.0:1787758921.930365:0:6666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 00000000af437f58/0xa3b7f37aab2d070 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa3b7f37aab2d077 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.930380:0:6666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 00000000af437f58/0xa3b7f37aab2d070 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa3b7f37aab2d077 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758921.930469:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006dc4172f pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068991104:0@lo:501: 00000100:00100000:2.0:1787758921.930496:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758921.930513:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a34f241c going to sleep for 11 seconds 00000100:00100000:3.0:1787758921.930534:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068991104 00000100:00100000:3.0:1787758921.930539:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068991104 00000100:00100000:3.0:1787758921.930561:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787758921.930566:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044f9bdd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+8:6666:x1874601068991104:12345-0@lo:501: 00000100:00100000:3.0:1787758921.930720:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044f9bdd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+8:6666:x1874601068991104:12345-0@lo:501: Request processed in 154us (224us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787758921.930726:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787758921.930742:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006dc4172f pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068991104:0@lo:501: 10000000:01000000:2.0:1787758921.930759:0:6666:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787758921.930782:0:6666:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787758921.930786:0:6666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: 00000000af437f58/0xa3b7f37aab2d070 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa3b7f37aab2d077 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.930793:0:6666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: 00000000af437f58/0xa3b7f37aab2d070 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa3b7f37aab2d077 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.930800:0:6666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.154@tcp lock: 00000000af437f58/0xa3b7f37aab2d070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa3b7f37aab2d077 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.930818:0:6666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787758921.930833:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1787758921.930834:0:6666:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ccc782b000 10000000:01000000:2.0:1787758921.930840:0:6666:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787758921.930841:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: 00000000af437f58/0xa3b7f37aab2d070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa3b7f37aab2d077 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758921.930843:0:6666:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99ccc74c3490 10000000:01000000:2.0:1787758921.930849:0:6666:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1787758921.930851:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000af437f58 already unused, calling callback (00000000c496ff98) 10000000:00010000:0.0:1787758921.930855:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: 00000000af437f58/0xa3b7f37aab2d070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa3b7f37aab2d077 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758921.930855:0:6666:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99ccc74c3490 from 1 10000000:01000000:2.0:1787758921.930861:0:6666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787758921.930865:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: 00000000af437f58/0xa3b7f37aab2d070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xa3b7f37aab2d077 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758921.930870:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: 00000000af437f58/0xa3b7f37aab2d070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xa3b7f37aab2d077 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758921.930873:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787758921.930878:0:6666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 00000000c5178663/0xa3b7f37aab2d07e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.930890:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: 00000000af437f58/0xa3b7f37aab2d070 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa3b7f37aab2d077 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.930906:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787758921.930909:0:6666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: 00000000c5178663/0xa3b7f37aab2d07e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.930918:0:6666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 00000000c5178663/0xa3b7f37aab2d07e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.930926:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: 00000000af437f58/0xa3b7f37aab2d070 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa3b7f37aab2d077 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.930933:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: 00000000af437f58/0xa3b7f37aab2d070 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa3b7f37aab2d077 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758921.930933:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006dc4172f pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068991232:0@lo:101: 00000100:00100000:3.0:1787758921.930955:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1787758921.930966:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758921.930969:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758921.930969:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b29d6e62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601068991360:0@lo:103: 00010000:00010000:0.0:1787758921.930973:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787758921.930978:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758921.931004:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758921.931007:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068991232 00000100:00100000:2.0:1787758921.931010:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9d8a610 going to sleep for 11 seconds 00000100:00100000:0.0:1787758921.931013:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068991232 00000100:00100000:0.0:1787758921.931053:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787758921.931062:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad9d0638 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+8:6666:x1874601068991232:12345-0@lo:101: 00010000:00010000:0.0:1787758921.931068:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787758921.931071:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068991360 00010000:00010000:0.0:1787758921.931074:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f13d0ce2/0xa3b7f37aab2d085 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d07e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758921.931086:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068991360 00010000:00010000:0.0:1787758921.931088:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f13d0ce2/0xa3b7f37aab2d085 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d07e expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.931099:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f13d0ce2/0xa3b7f37aab2d085 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d07e expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.931105:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f13d0ce2, rc 0) 00000100:00100000:0.0:1787758921.931156:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad9d0638 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:6666:x1874601068991232:12345-0@lo:101: Request processed in 92us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758921.931158:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787758921.931169:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006dc4172f pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068991232:0@lo:101: 00000100:00100000:0.0:1787758921.931174:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787758921.931187:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f0740bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:3292:x1874601068991360:12345-0@lo:103: 00010000:00010000:3.0:1787758921.931191:0:6666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 00000000c5178663/0xa3b7f37aab2d07e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d085 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.931202:0:6666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 00000000c5178663/0xa3b7f37aab2d07e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d085 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758921.931207:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:3.0:1787758921.931215:0:6666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787758921.931225:0:6666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: 00000000c5178663/0xa3b7f37aab2d07e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d085 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758921.931228:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009e9ea71d/0xa3b7f37aab2d077 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa3b7f37aab2d070 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.931240:0:6666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: 00000000c5178663/0xa3b7f37aab2d07e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d085 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787758921.931251:0:6666:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787758921.931256:0:6666:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787758921.931264:0:6666:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787758921.931271:0:6666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787758921.931289:0:6666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 00000000bc605be5/0xa3b7f37aab2d08c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758921.931293:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787758921.931297:0:6666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: 00000000bc605be5/0xa3b7f37aab2d08c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.931303:0:6666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 00000000bc605be5/0xa3b7f37aab2d08c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758921.931311:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014357f19 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068991488:0@lo:101: 00000100:00100000:3.0:1787758921.931351:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758921.931388:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f0740bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+8:3292:x1874601068991360:12345-0@lo:103: Request processed in 207us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758921.931388:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a762bc8b going to sleep for 11 seconds 00000100:00100000:0.0:1787758921.931391:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068991488 00000100:00100000:0.0:1787758921.931397:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068991488 00000100:00100000:2.0:1787758921.931400:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b29d6e62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601068991360:0@lo:103: 00000100:00100000:1.0:1787758921.931418:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787758921.931433:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787758921.931444:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce8e838d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+8:6666:x1874601068991488:12345-0@lo:101: 00010000:00010000:0.0:1787758921.931450:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758921.931458:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000003d23734/0xa3b7f37aab2d093 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d08c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.931481:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000003d23734/0xa3b7f37aab2d093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d08c expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.931489:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000003d23734/0xa3b7f37aab2d093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d08c expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.931495:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000003d23734, rc 0) 00000100:00100000:0.0:1787758921.931530:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce8e838d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:6666:x1874601068991488:12345-0@lo:101: Request processed in 90us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758921.931537:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787758921.931554:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014357f19 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068991488:0@lo:101: 00010000:00010000:3.0:1787758921.931565:0:6666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 00000000bc605be5/0xa3b7f37aab2d08c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d093 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.931571:0:6666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 00000000bc605be5/0xa3b7f37aab2d08c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d093 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758921.931649:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014357f19 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068991616:0@lo:501: 00000100:00100000:3.0:1787758921.931673:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758921.931704:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068991616 00000100:00100000:0.0:1787758921.931708:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068991616 00000100:00100000:3.0:1787758921.931710:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a762bc8b going to sleep for 11 seconds 00000100:00100000:0.0:1787758921.931730:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787758921.931734:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b583f605 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:6666:x1874601068991616:12345-0@lo:501: 00000100:00100000:0.0:1787758921.931858:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b583f605 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:6666:x1874601068991616:12345-0@lo:501: Request processed in 123us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758921.931862:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787758921.931887:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014357f19 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068991616:0@lo:501: 00000100:00100000:3.0:1787758921.931911:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014357f19 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068991744:0@lo:503: 00000100:00100000:3.0:1787758921.931943:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758921.931958:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a762bc8b going to sleep for 11 seconds 00000100:00100000:0.0:1787758921.931966:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068991744 00000100:00100000:0.0:1787758921.931970:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068991744 00000100:00100000:0.0:1787758921.931994:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787758921.932003:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000274afecf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:6666:x1874601068991744:12345-0@lo:503: 00000100:00100000:0.0:1787758921.932111:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000274afecf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:6666:x1874601068991744:12345-0@lo:503: Request processed in 111us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758921.932118:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014357f19 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068991744:0@lo:503: 00000100:00100000:0.0:1787758921.932121:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000040:00080000:3.0:1787758921.932323:0:6666:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787758921.932373:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014357f19 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068991872:0@lo:502: 00000100:00100000:3.0:1787758921.932406:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758921.932419:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a762bc8b going to sleep for 11 seconds 00000100:00100000:0.0:1787758921.932433:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068991872 00000100:00100000:0.0:1787758921.932437:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068991872 00000100:00100000:0.0:1787758921.932455:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787758921.932468:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003189f4fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:6666:x1874601068991872:12345-0@lo:502: 00000100:00100000:0.0:1787758921.932578:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003189f4fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:6666:x1874601068991872:12345-0@lo:502: Request processed in 111us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758921.932584:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787758921.932597:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014357f19 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068991872:0@lo:502: 00000040:00080000:3.0:1787758921.932787:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787758921.932816:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787758921.932832:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787758921.932877:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787758921.932907:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787758921.932924:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787758921.932936:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014357f19 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068992000:0@lo:502: 00000100:00100000:3.0:1787758921.932958:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758921.932974:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a762bc8b going to sleep for 11 seconds 00000100:00100000:0.0:1787758921.933001:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068992000 00000100:00100000:0.0:1787758921.933005:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068992000 00000100:00100000:0.0:1787758921.933024:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787758921.933028:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8276f10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:6666:x1874601068992000:12345-0@lo:502: 00000100:00100000:0.0:1787758921.933109:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8276f10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:6666:x1874601068992000:12345-0@lo:502: Request processed in 81us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758921.933115:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014357f19 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068992000:0@lo:502: 00000100:00100000:0.0:1787758921.933119:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000040:00080000:3.0:1787758921.933170:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787758921.933176:0:6666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787758921.933455:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787758921.933462:0:6687:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787758921.933467:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787758921.933469:0:6687:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787758921.933472:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787758921.933486:0:6687:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (0000000018cf1130) 00000020:00000080:3.0:1787758921.933507:0:6687:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787758921.933512:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787758921.933577:0:6687:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005bdc8fc1 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787758921.933582:0:6687:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787758921.933587:0:6687:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa3b7f37aab2d0a1 00010000:00010000:3.0:1787758921.936461:0:6687:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787758921.936703:0:6687:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787758921.938121:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787758921.938239:0:6687:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787758921.940908:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787758921.941223:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787758921.942477:0:6687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787758921.942489:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787758921.942494:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758921.942496:0:6687:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787758921.942499:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787758921.942503:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758921.942505:0:6687:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787758921.942508:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787758921.942509:0:6687:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787758921.942556:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787758921.942562:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758921.942563:0:6687:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787758921.942566:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787758921.942660:0:6666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787758921.942717:0:6666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787758921.942737:0:6666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: 00000000bc605be5/0xa3b7f37aab2d08c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d093 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.942749:0:6666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: 00000000bc605be5/0xa3b7f37aab2d08c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d093 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758921.942758:0:6666:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ccc782b000 from 1 10000000:01000000:2.0:1787758921.942762:0:6666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787758921.942804:0:6666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 00000000011560cf/0xa3b7f37aab2d0a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.942812:0:6666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: 00000000011560cf/0xa3b7f37aab2d0a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.942822:0:6666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 00000000011560cf/0xa3b7f37aab2d0a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758921.942859:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a05976f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068992128:0@lo:101: 00000100:00100000:2.0:1787758921.942936:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758921.942993:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068992128 00000100:00100000:2.0:1787758921.943000:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a57fc0b3 going to sleep for 11 seconds 00000100:00100000:1.0:1787758921.943001:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068992128 00000100:00100000:1.0:1787758921.943060:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787758921.943071:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b203f803 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+9:6666:x1874601068992128:12345-0@lo:101: 00010000:00010000:1.0:1787758921.943085:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758921.943101:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032e91ee3/0xa3b7f37aab2d0af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d0a8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758921.943125:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032e91ee3/0xa3b7f37aab2d0af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d0a8 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758921.943135:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032e91ee3/0xa3b7f37aab2d0af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d0a8 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758921.943157:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032e91ee3, rc 0) 00000100:00100000:1.0:1787758921.943217:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b203f803 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:6666:x1874601068992128:12345-0@lo:101: Request processed in 149us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758921.943224:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787758921.943270:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a05976f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068992128:0@lo:101: 00010000:00010000:2.0:1787758921.943288:0:6666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 00000000011560cf/0xa3b7f37aab2d0a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d0af expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.943296:0:6666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 00000000011560cf/0xa3b7f37aab2d0a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d0af expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758921.943378:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a05976f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068992256:0@lo:501: 00000100:00100000:2.0:1787758921.943408:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758921.943432:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a57fc0b3 going to sleep for 11 seconds 00000100:00100000:1.0:1787758921.943462:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068992256 00000100:00100000:1.0:1787758921.943468:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068992256 00000100:00100000:1.0:1787758921.943495:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787758921.943501:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad389720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:6666:x1874601068992256:12345-0@lo:501: 00000100:00100000:1.0:1787758921.944408:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad389720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:6666:x1874601068992256:12345-0@lo:501: Request processed in 906us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758921.944416:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787758921.944454:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a05976f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068992256:0@lo:501: 00000100:00100000:2.0:1787758921.944486:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a05976f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068992384:0@lo:503: 00000100:00100000:2.0:1787758921.944530:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758921.944558:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a57fc0b3 going to sleep for 11 seconds 00000100:00100000:1.0:1787758921.944572:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068992384 00000100:00100000:1.0:1787758921.944579:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068992384 00000100:00100000:1.0:1787758921.944643:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787758921.944651:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008c8a72b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:6666:x1874601068992384:12345-0@lo:503: 00000100:00100000:1.0:1787758921.944893:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008c8a72b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:6666:x1874601068992384:12345-0@lo:503: Request processed in 243us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758921.944900:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787758921.944941:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a05976f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068992384:0@lo:503: 00000040:00080000:2.0:1787758921.945206:0:6666:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787758921.945266:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a05976f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068992512:0@lo:502: 00000100:00100000:2.0:1787758921.945311:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758921.945346:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a57fc0b3 going to sleep for 11 seconds 00000100:00100000:1.0:1787758921.945357:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068992512 00000100:00100000:1.0:1787758921.945363:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068992512 00000100:00100000:1.0:1787758921.945397:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787758921.945405:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f6a0f39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:6666:x1874601068992512:12345-0@lo:502: 00000100:00100000:1.0:1787758921.945592:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f6a0f39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:6666:x1874601068992512:12345-0@lo:502: Request processed in 189us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758921.945600:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787758921.945659:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a05976f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068992512:0@lo:502: 00000040:00080000:2.0:1787758921.945895:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787758921.945951:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787758921.945969:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a05976f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068992640:0@lo:502: 00000100:00100000:2.0:1787758921.945999:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758921.946020:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a57fc0b3 going to sleep for 11 seconds 00000100:00100000:1.0:1787758921.946042:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068992640 00000100:00100000:1.0:1787758921.946054:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068992640 00000100:00100000:1.0:1787758921.946086:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787758921.946094:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000adc73530 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:6666:x1874601068992640:12345-0@lo:502: 00000100:00100000:1.0:1787758921.946244:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000adc73530 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:6666:x1874601068992640:12345-0@lo:502: Request processed in 150us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758921.946256:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787758921.946276:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a05976f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068992640:0@lo:502: 00000040:00080000:2.0:1787758921.946349:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787758921.946355:0:6666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787758921.946683:0:6691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787758921.946704:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758921.946706:0:6691:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787758921.946712:0:6691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ccc782b000 00000020:00000080:1.0:1787758921.946714:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787758921.946747:0:6691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787758921.946750:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758921.946751:0:6691:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787758921.946754:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787758921.946807:0:6666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787758921.946832:0:6666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787758921.946854:0:6666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d0a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d0af expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.946864:0:6666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d0a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d0af expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758921.946907:0:6666:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787758921.946910:0:6666:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ccc782b000 10000000:01000000:2.0:1787758921.946913:0:6666:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ccc782b000 10000000:01000000:2.0:1787758921.946921:0:6666:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787758921.946927:0:6666:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ccc782b000 from 1 10000000:01000000:2.0:1787758921.946929:0:6666:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787758921.946953:0:6666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d0b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.946961:0:6666:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d0b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.946969:0:6666:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d0b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758921.946980:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc6969680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068992768:0@lo:101: 00000100:00100000:2.0:1787758921.947018:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758921.947045:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc508c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787758921.947069:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068992768 00000100:00100000:1.0:1787758921.947076:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068992768 00000100:00100000:1.0:1787758921.947108:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787758921.947119:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7421c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+10:6666:x1874601068992768:12345-0@lo:101: 00010000:00010000:1.0:1787758921.947129:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758921.947139:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d0bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d0b6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758921.947157:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d0bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d0b6 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758921.947168:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d0bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d0b6 expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758921.947176:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd02047400, rc 0) 00000100:00100000:1.0:1787758921.947225:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7421c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:6666:x1874601068992768:12345-0@lo:101: Request processed in 107us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758921.947233:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787758921.947244:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc6969680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068992768:0@lo:101: 00010000:00010000:2.0:1787758921.947265:0:6666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d0b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d0bd expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758921.947275:0:6666:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d0b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d0bd expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758921.947332:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc6969680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068992896:0@lo:501: 00000100:00100000:2.0:1787758921.947362:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758921.947385:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc508c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787758921.947406:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068992896 00000100:00100000:1.0:1787758921.947412:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068992896 00000100:00100000:1.0:1787758921.947454:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787758921.947470:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7421450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:6666:x1874601068992896:12345-0@lo:501: 00000100:00100000:1.0:1787758921.947733:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7421450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:6666:x1874601068992896:12345-0@lo:501: Request processed in 267us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758921.947742:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787758921.947761:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc6969680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068992896:0@lo:501: 00000100:00100000:2.0:1787758921.947790:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc6969680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068993024:0@lo:503: 00000100:00100000:2.0:1787758921.947820:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758921.947839:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc508c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787758921.947860:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068993024 00000100:00100000:1.0:1787758921.947866:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068993024 00000100:00100000:1.0:1787758921.947901:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787758921.947910:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7421850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:6666:x1874601068993024:12345-0@lo:503: 00000100:00100000:1.0:1787758921.948084:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7421850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:6666:x1874601068993024:12345-0@lo:503: Request processed in 175us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758921.948091:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787758921.948131:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc6969680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068993024:0@lo:503: 00000040:00080000:2.0:1787758921.948313:0:6666:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787758921.948345:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc6969680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068993152:0@lo:502: 00000100:00100000:2.0:1787758921.948376:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758921.948391:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc508c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787758921.948416:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068993152 00000100:00100000:1.0:1787758921.948423:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068993152 00000100:00100000:1.0:1787758921.948457:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787758921.948468:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7421050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:6666:x1874601068993152:12345-0@lo:502: 00000100:00100000:1.0:1787758921.948803:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7421050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:6666:x1874601068993152:12345-0@lo:502: Request processed in 337us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758921.948810:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787758921.948895:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc6969680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068993152:0@lo:502: 00000040:00080000:0.0:1787758921.949332:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787758921.949447:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787758921.949533:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787758921.949592:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787758921.949673:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787758921.949750:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787758921.949861:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787758921.949908:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787758921.949949:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787758921.949979:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787758921.950008:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787758921.950054:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787758921.950099:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787758921.950128:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787758921.950167:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787758921.950197:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787758921.950226:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787758921.950289:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787758921.950319:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787758921.950347:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787758921.950384:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787758921.950413:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787758921.950440:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787758921.950479:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787758921.950507:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787758921.950537:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787758921.950582:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787758921.950613:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1787758921.950712:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1367c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068993280:0@lo:502: 00000100:00100000:0.0:1787758921.950754:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758921.950791:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068993280 00000100:00100000:0.0:1787758921.950794:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99cccfd2fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787758921.950797:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068993280 00000100:00100000:1.0:1787758921.950828:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787758921.950835:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7422c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:6666:x1874601068993280:12345-0@lo:502: 00000100:00100000:1.0:1787758921.950964:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7422c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:6666:x1874601068993280:12345-0@lo:502: Request processed in 129us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758921.950972:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787758921.950995:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1367c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068993280:0@lo:502: 00000040:00080000:0.0:1787758921.951056:0:6666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787758921.951064:0:6666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787758921.951413:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787758921.951436:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99cbc55d0000) 00000020:00000080:2.0:1787758921.951459:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1787758921.951528:0:6692:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ccc782b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787758921.951533:0:6692:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ccc782b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787758921.951540:0:6692:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccc782b000 3 00010000:00080000:2.0:1787758921.951574:0:6692:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbc55df000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.154@tcp at head 00010000:00010000:2.0:1787758921.953652:0:6692:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787758921.953813:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787758921.953833:0:6692:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787758921.953842:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa3b7f37aab2d0cb 00000100:00080000:2.0:1787758921.953849:0:6692:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787758921.953854:0:6692:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99cbc55df000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:2.0:1787758921.953882:0:6692:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccc696b480 x1874601068993408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787758921.953903:0:6692:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787758921.953935:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc696b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3289:1874601068993408:0@lo:38: 00000100:00100000:0.0:1787758921.953992:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758921.953995:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce138b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874601068993536:0@lo:400: 00000100:00100000:3.0:1787758921.954055:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758921.954125:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068993408 00000100:00100000:0.0:1787758921.954132:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068993408 00000100:00100000:3.0:1787758921.954151:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068993536 00000100:00100000:3.0:1787758921.954159:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068993536 00000040:00080000:2.0:1787758921.954177:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:0.0:1787758921.954183:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787758921.954198:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1367c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3289:x1874601068993408:12345-0@lo:38: 00010000:00080000:0.0:1787758921.954224:0:5822:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 72 last 0 00000100:00100000:3.0:1787758921.954228:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787758921.954250:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce138bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1874601068993536:12345-0@lo:400: 00000020:00000080:0.0:1787758921.954317:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa3b7f37aab2d0d2 00000100:00100000:3.0:1787758921.954326:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce138bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1874601068993536:12345-0@lo:400: Request processed in 83us (275us total) trans 0 rc 0/0 00000004:00100000:0.0:1787758921.954334:0:5822:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1787758921.954342:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787758921.954381:0:5822:0:(import.c:65:import_set_state_nolock()) ffff99cccfdc5000 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1787758921.954390:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99cce138b0c0 x1874601068993536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758921.954406:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce138b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874601068993536:0@lo:400: 00000100:00100000:0.0:1787758921.954442:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1367c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1874601068993408:12345-0@lo:38: Request processed in 247us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758921.954458:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787758921.954469:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99ccc696b480 x1874601068993408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787758931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758921.954476:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787758921.954483:0:3289:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787758921.954489:0:3289:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:01000000:0.0:1787758921.954493:0:6666:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 00000100:00080000:2.0:1787758921.954493:0:3289:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787758921.954501:0:3289:0:(import.c:65:import_set_state_nolock()) ffff99cbc55df000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787758921.954510:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc696b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3289:1874601068993408:0@lo:38: 10000000:01000000:0.0:1787758921.954533:0:6666:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787758921.954553:0:6666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d0b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d0bd expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758921.954563:0:6666:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d0b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d0bd expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787758921.954649:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787758921.954652:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787758921.954654:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787758921.954655:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787758921.954657:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787758921.954660:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787758921.954662:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787758921.954664:0:6666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787758921.954666:0:6666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787758921.954667:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787758921.954669:0:6666:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787758921.954672:0:6666:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787758921.954675:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787758921.954677:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787758921.954679:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787758921.954680:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787758921.954682:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787758921.954684:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787758921.954685:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787758921.954687:0:6666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787758921.954701:0:6666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787758921.954703:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787758921.954705:0:6666:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787758921.954720:0:6666:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787758921.954731:0:6666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1365e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068993664:0@lo:253: 00000100:00100000:0.0:1787758921.954766:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758921.954810:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068993664 00000100:00100000:2.0:1787758921.954816:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068993664 00000100:00100000:0.0:1787758921.954819:0:6666:0:(client.c:2715:ptlrpc_set_wait()) set ffff99cccfd2fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787758921.954849:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787758921.954855:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7420450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:6666:x1874601068993664:12345-0@lo:253: 20000000:01000000:2.0:1787758921.954875:0:5815:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787758921.954889:0:5815:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787758921.963300:0:5815:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787758921.963318:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787758921.963332:0:5837:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787758921.963340:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787758921.963363:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccd96fcc00/0xa3b7f37aab2d0d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.963377:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccd96fcc00/0xa3b7f37aab2d0d9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787758921.963392:0:5837:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001310059s 00010000:00010000:3.0:1787758921.963396:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccd96fcc00/0xa3b7f37aab2d0d9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.963402:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccd96fcc00/0xa3b7f37aab2d0d9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.963407:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccd96fcc00/0xa3b7f37aab2d0d9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.963412:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccd96fcc00/0xa3b7f37aab2d0d9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.963419:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccd96fcc00 already unused, calling callback (ffffffffc1666530) 00010000:00010000:3.0:1787758921.963424:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccd96fcc00/0xa3b7f37aab2d0d9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.963430:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccd96fcc00/0xa3b7f37aab2d0d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.963444:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccd96fcc00/0xa3b7f37aab2d0d9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.963450:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccd96fcc00/0xa3b7f37aab2d0d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758921.963454:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccd96fcc00/0xa3b7f37aab2d0d9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758921.965653:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7420450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:6666:x1874601068993664:12345-0@lo:253: Request processed in 10792us (10881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758921.965665:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787758921.965675:0:6666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1365e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:6666:1874601068993664:0@lo:253: 10000000:01000000:0.0:1787758921.965702:0:6666:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787758921.965705:0:6666:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787758921.965706:0:6666:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787758921.965708:0:6666:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787758921.965710:0:6666:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787758921.965711:0:6666:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787758921.965712:0:6666:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787758921.965714:0:6666:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787758921.965715:0:6666:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787758921.965717:0:6666:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787758921.965718:0:6666:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787758921.965719:0:6666:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787758921.965731:0:6666:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787758921.968295:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787758921.968459:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787758921.968686:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787758921.968861:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787758921.969073:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:0.0:1787758921.969218:0:6666:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787758921.970088:0:6666:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787758922.062684:0:6666:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787758922.062705:0:6666:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787758922.062770:0:6666:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787758922.062911:0:6666:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787758922.062932:0:6666:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787758922.062952:0:6666:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787758922.780784:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758923.804710:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787758924.117186:0:7035:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787758924.828829:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787758924.892781:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787758924.892793:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ccd06d3800 from 21 10000000:01000000:3.0:1787758924.892800:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787758924.892886:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccd96fcc00/0xa3b7f37aab2d0e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758924.892899:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99ccd96fcc00/0xa3b7f37aab2d0e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758924.892916:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99ccd96fcc00/0xa3b7f37aab2d0e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758924.892945:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068993792:0@lo:101: 00000100:00100000:3.0:1787758924.893035:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758924.893108:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccd80549c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758924.893110:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068993792 00000100:00100000:1.0:1787758924.893120:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068993792 00000100:00100000:1.0:1787758924.893178:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787758924.893187:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7423450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:5818:x1874601068993792:12345-0@lo:101: 00010000:00010000:1.0:1787758924.893201:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758924.893212:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd02046e00/0xa3b7f37aab2d0e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d0e0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758924.893235:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd02046e00/0xa3b7f37aab2d0e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d0e0 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758924.893243:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd02046e00/0xa3b7f37aab2d0e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d0e0 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758924.893268:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd02046e00, rc 0) 00000100:00100000:1.0:1787758924.893308:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7423450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:5818:x1874601068993792:12345-0@lo:101: Request processed in 123us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758924.893314:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787758924.893350:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068993792:0@lo:101: 00010000:00010000:3.0:1787758924.893368:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99ccd96fcc00/0xa3b7f37aab2d0e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d0e7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758924.893378:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99ccd96fcc00/0xa3b7f37aab2d0e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d0e7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758924.893425:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068993920:0@lo:501: 00000100:00100000:3.0:1787758924.893444:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758924.893457:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccd80549c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758924.893476:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068993920 00000100:00100000:1.0:1787758924.893479:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068993920 00000100:00100000:1.0:1787758924.893496:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787758924.893501:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7420850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:5818:x1874601068993920:12345-0@lo:501: 00000100:00100000:1.0:1787758924.893931:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7420850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:5818:x1874601068993920:12345-0@lo:501: Request processed in 428us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758924.893939:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787758924.893968:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068993920:0@lo:501: 00000100:00100000:3.0:1787758924.893992:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068994048:0@lo:503: 00000100:00100000:3.0:1787758924.894028:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758924.894053:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccd80549c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758924.894066:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068994048 00000100:00100000:1.0:1787758924.894072:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068994048 00000100:00100000:1.0:1787758924.894096:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787758924.894104:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7422850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:5818:x1874601068994048:12345-0@lo:503: 00000100:00100000:1.0:1787758924.894318:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7422850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:5818:x1874601068994048:12345-0@lo:503: Request processed in 216us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758924.894323:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787758924.894355:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068994048:0@lo:503: 00000100:00100000:1.0:1787758924.894669:0:7140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1090b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7140:1874601068994176:0@lo:502: 00000100:00100000:1.0:1787758924.894702:0:7140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758924.894722:0:7140:0:(client.c:2715:ptlrpc_set_wait()) set ffff99cbc4eb2180 going to sleep for 11 seconds 00000100:00100000:2.0:1787758924.894750:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068994176 00000100:00100000:2.0:1787758924.894756:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068994176 00000100:00100000:2.0:1787758924.894788:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787758924.894795:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7423850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:7140:x1874601068994176:12345-0@lo:502: 00000100:00100000:2.0:1787758924.895027:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7423850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:7140:x1874601068994176:12345-0@lo:502: Request processed in 232us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758924.895035:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787758924.895054:0:7140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1090b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7140:1874601068994176:0@lo:502: 00000100:00100000:1.0:1787758924.895101:0:7140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1090b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7140:1874601068994304:0@lo:502: 00000100:00100000:1.0:1787758924.895128:0:7140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758924.895149:0:7140:0:(client.c:2715:ptlrpc_set_wait()) set ffff99cbc4eb2180 going to sleep for 11 seconds 00000100:00100000:0.0:1787758924.895186:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068994304 00000100:00100000:0.0:1787758924.895192:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068994304 00000100:00100000:0.0:1787758924.895226:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787758924.895237:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7422450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:7140:x1874601068994304:12345-0@lo:502: 00000100:00100000:0.0:1787758924.895385:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7422450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:7140:x1874601068994304:12345-0@lo:502: Request processed in 149us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758924.895393:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787758924.895421:0:7140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1090b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7140:1874601068994304:0@lo:502: 00000040:00080000:1.0:1787758924.895443:0:7140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787758924.895529:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787758924.895544:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787758924.895552:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccd96fcc00/0xa3b7f37aab2d0e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d0e7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758924.895563:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99ccd96fcc00/0xa3b7f37aab2d0e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d0e7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787758924.895573:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787758924.895576:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99ccd06d3800 from 3 10000000:01000000:3.0:1787758924.895580:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787758924.895601:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d0ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758924.895606:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d0ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758924.895631:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d0ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758924.895657:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068994432:0@lo:101: 00000100:00100000:3.0:1787758924.895685:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758924.895710:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccd80549c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758924.895734:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068994432 00000100:00100000:2.0:1787758924.895741:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068994432 00000100:00100000:2.0:1787758924.895776:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787758924.895783:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7423050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:5818:x1874601068994432:12345-0@lo:101: 00010000:00010000:2.0:1787758924.895792:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758924.895807:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cccf888400/0xa3b7f37aab2d0f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d0ee expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758924.895827:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cccf888400/0xa3b7f37aab2d0f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d0ee expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758924.895837:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cccf888400/0xa3b7f37aab2d0f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d0ee expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758924.895846:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cccf888400, rc 0) 00000100:00100000:2.0:1787758924.895887:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7423050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:5818:x1874601068994432:12345-0@lo:101: Request processed in 104us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758924.895893:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787758924.895929:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068994432:0@lo:101: 00010000:00010000:3.0:1787758924.895942:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d0ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d0f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758924.895953:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d0ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d0f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758924.896005:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068994560:0@lo:256: 00000100:00100000:3.0:1787758924.896037:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758924.896057:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccd80549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787758924.896082:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068994560 00000100:00100000:0.0:1787758924.896087:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068994560 00000100:00100000:0.0:1787758924.896114:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787758924.896125:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:5818:x1874601068994560:12345-0@lo:256: 20000000:01000000:0.0:1787758924.896138:0:5816:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787758924.896152:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787758924.896155:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1787758924.896157:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 4 00000100:00100000:0.0:1787758924.896248:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:5818:x1874601068994560:12345-0@lo:256: Request processed in 122us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758924.896257:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787758924.896260:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068994560:0@lo:256: 10000000:01000000:3.0:1787758924.896309:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787758924.896314:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d0ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d0f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758924.896322:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d0ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d0f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787758924.896330:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787758924.896332:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787758924.896335:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787758924.896347:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd000/0xa3b7f37aab2d0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758924.896352:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd000/0xa3b7f37aab2d0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758924.896357:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd000/0xa3b7f37aab2d0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758924.896364:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068994688:0@lo:101: 00000100:00100000:3.0:1787758924.896383:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758924.896401:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccd80549c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758924.896426:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068994688 00000100:00100000:2.0:1787758924.896431:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068994688 00000100:00100000:2.0:1787758924.896453:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787758924.896460:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:5818:x1874601068994688:12345-0@lo:101: 00010000:00010000:2.0:1787758924.896473:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758924.896482:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d0fc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758924.896495:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d0fc expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758924.896504:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d0fc expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758924.896511:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cccf889800, rc 0) 00000100:00100000:2.0:1787758924.896539:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:5818:x1874601068994688:12345-0@lo:101: Request processed in 79us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758924.896546:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787758924.896553:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068994688:0@lo:101: 00010000:00010000:3.0:1787758924.896569:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd000/0xa3b7f37aab2d0fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d103 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758924.896577:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd000/0xa3b7f37aab2d0fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d103 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758924.896648:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068994816:0@lo:501: 00000100:00100000:3.0:1787758924.896675:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758924.896699:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccd80549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787758924.896716:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068994816 00000100:00100000:0.0:1787758924.896722:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068994816 00000100:00100000:0.0:1787758924.896750:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787758924.896759:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:5818:x1874601068994816:12345-0@lo:501: 00000100:00100000:0.0:1787758924.896958:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:5818:x1874601068994816:12345-0@lo:501: Request processed in 201us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758924.896966:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787758924.897045:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068994816:0@lo:501: 00000100:00100000:3.0:1787758924.897068:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068994944:0@lo:503: 00000100:00100000:3.0:1787758924.897101:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758924.897122:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccd80549c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758924.897154:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068994944 00000100:00100000:2.0:1787758924.897158:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068994944 00000100:00100000:2.0:1787758924.897178:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787758924.897182:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:5818:x1874601068994944:12345-0@lo:503: 00000100:00100000:2.0:1787758924.897392:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:5818:x1874601068994944:12345-0@lo:503: Request processed in 209us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758924.897398:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787758924.897418:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068994944:0@lo:503: 00000100:00100000:0.0:1787758924.897736:0:7141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce13661c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7141:1874601068995072:0@lo:502: 00000100:00100000:0.0:1787758924.897771:0:7141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758924.897796:0:7141:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc31300c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758924.897806:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068995072 00000100:00100000:1.0:1787758924.897812:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068995072 00000100:00100000:1.0:1787758924.897843:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787758924.897851:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:7141:x1874601068995072:12345-0@lo:502: 00000100:00100000:1.0:1787758924.898033:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:7141:x1874601068995072:12345-0@lo:502: Request processed in 183us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758924.898041:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787758924.898071:0:7141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce13661c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7141:1874601068995072:0@lo:502: 00000020:01000000:0.0:1787758924.898097:0:7141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787758924.898104:0:7141:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787758924.898112:0:7141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758924.898114:0:7141:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787758924.898119:0:7141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787758924.898123:0:7141:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.154@tcp to nid 0x20000c0a8c99a (192.168.201.154@tcp) 00000020:01000000:0.0:1787758924.898147:0:7141:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787758924.898149:0:7141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787758924.898176:0:7141:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99ccf6070000) 00000020:00000080:0.0:1787758924.898194:0:7141:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787758924.898199:0:7141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787758924.898268:0:7141:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787758924.898274:0:7141:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787758924.898293:0:7141:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa3b7f37aab2d111 00010000:00080000:0.0:1787758924.898324:0:7141:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ccc8015800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.154@tcp at head 00010000:00010000:0.0:1787758924.898587:0:7141:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787758924.908082:0:7141:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787758924.908112:0:7141:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787758924.908477:0:7141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787758924.908606:0:7141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787758924.908706:0:7141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787758924.908748:0:7141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787758924.909073:0:7142:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787758924.909077:0:7142:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787758924.909405:0:7141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787758924.909415:0:7141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787758924.909443:0:7141:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787758924.909462:0:7141:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa3b7f37aab2d118 00000100:00080000:0.0:1787758924.909473:0:7141:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787758924.909478:0:7141:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99ccc8015800 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:0.0:1787758924.909515:0:7141:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99cce13661c0 x1874601068995200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787758924.909534:0:7141:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1787758924.909566:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce13661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3289:1874601068995200:0@lo:8: 00000020:01000000:0.0:1787758924.909598:0:7141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787758924.909604:0:7141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758924.909606:0:7141:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787758924.909610:0:7141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787758924.909645:0:7141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758924.909647:0:7141:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787758924.909659:0:7141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787758924.909662:0:7141:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787758924.909669:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874601068995328:0@lo:400: 00000100:00100000:2.0:1787758924.909685:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758924.909689:0:7141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7141:1874601068995584:0@lo:502: 00000100:00100000:3.0:1787758924.909697:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787758924.909710:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1388780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3293:1874601068995456:0@lo:400: 00000100:00100000:1.0:1787758924.909733:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758924.909749:0:7141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758924.909763:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068995328 00000100:00100000:3.0:1787758924.909770:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068995328 00000100:00100000:2.0:1787758924.909778:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068995200 00000100:00100000:0.0:1787758924.909780:0:7141:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc3130a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787758924.909782:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068995200 00000100:00100000:2.0:1787758924.909816:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787758924.909820:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787758924.909825:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc696b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3289:x1874601068995200:12345-0@lo:8: 00000100:00100000:1.0:1787758924.909827:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787758924.909832:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1090b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874601068995328:12345-0@lo:400: 00000100:00100000:1.0:1787758924.909840:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:2.0:1787758924.909853:0:6669:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 75 last 0 00000020:00000080:2.0:1787758924.909894:0:6669:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa3b7f37aab2d11f 00000100:00100000:3.0:1787758924.909901:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1090b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874601068995328:12345-0@lo:400: Request processed in 72us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758924.909910:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00100000:2.0:1787758924.909929:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99cbc55de000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 0 00010000:00080000:1.0:1787758924.909930:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cce13883c0 x1874601068995328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1787758924.909938:0:6669:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000100:00100000:3.0:1787758924.909939:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:2.0:1787758924.909946:0:6669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787758924.909954:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce13883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874601068995328:0@lo:400: 00000100:00100000:0.0:1787758924.909966:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068995456 00000100:00100000:0.0:1787758924.909971:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068995456 00000100:00080000:3.0:1787758924.910013:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787758924.910018:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787758924.910028:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce138a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874601068995456:12345-0@lo:400: 00002000:00100000:2.0:1787758924.910037:0:6669:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1787758924.910074:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce138a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874601068995456:12345-0@lo:400: Request processed in 48us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758924.910082:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787758924.910089:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cce1388780 x1874601068995456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758924.910108:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1388780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3293:1874601068995456:0@lo:400: 00002000:00080000:2.0:1787758924.910185:0:6669:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787758924.910210:0:6669:0:(import.c:65:import_set_state_nolock()) ffff99cbc55de800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787758924.910248:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc696b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3289:x1874601068995200:12345-0@lo:8: Request processed in 424us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758924.910254:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787758924.910281:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cce13661c0 x1874601068995200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787758934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758924.910282:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068995584 00000100:00100000:2.0:1787758924.910287:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068995584 00000100:00100000:0.0:1787758924.910292:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787758924.910298:0:3289:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787758924.910304:0:3289:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787758924.910310:0:3289:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00100000:2.0:1787758924.910311:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1787758924.910315:0:3289:0:(import.c:65:import_set_state_nolock()) ffff99ccc8015800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787758924.910319:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:7141:x1874601068995584:12345-0@lo:502: 00000004:00080000:0.0:1787758924.910333:0:3289:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787758924.910341:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce13661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3289:1874601068995200:0@lo:8: 00000004:00080000:0.0:1787758924.910365:0:7142:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787758924.910495:0:7142:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 75184878354ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787758924.910559:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:7141:x1874601068995584:12345-0@lo:502: Request processed in 241us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758924.910565:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787758924.910574:0:7141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7141:1874601068995584:0@lo:502: 00000020:01000000:0.0:1787758924.910601:0:7141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787758924.910605:0:7141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758924.910607:0:7141:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787758924.910610:0:7141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1787758924.910705:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787758924.910727:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787758924.910737:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd000/0xa3b7f37aab2d0fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d103 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758924.910746:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd000/0xa3b7f37aab2d0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d103 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758924.910755:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787758924.910758:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ccd06d3800 from 1 10000000:01000000:2.0:1787758924.910760:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787758924.910788:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d126 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758924.910795:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d126 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758924.910802:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d126 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758924.910824:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc6969680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068995712:0@lo:101: 00000100:00100000:2.0:1787758924.910849:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758924.910876:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068995712 00000100:00100000:1.0:1787758924.910880:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068995712 00000100:00100000:2.0:1787758924.910882:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfc9bf780 going to sleep for 11 seconds 00000100:00100000:1.0:1787758924.911456:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787758924.911680:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:5818:x1874601068995712:12345-0@lo:101: 00010000:00010000:1.0:1787758924.911691:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758924.911707:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd02047c00/0xa3b7f37aab2d12d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d126 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758924.911734:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd02047c00/0xa3b7f37aab2d12d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d126 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758924.911759:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd02047c00/0xa3b7f37aab2d12d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d126 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758924.911769:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd02047c00, rc 0) 00000100:00100000:1.0:1787758924.911814:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601068995712:12345-0@lo:101: Request processed in 351us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758924.911821:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787758924.911830:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc6969680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068995712:0@lo:101: 00010000:00010000:3.0:1787758924.911865:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d126 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d12d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758924.911877:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d126 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d12d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758924.912062:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1388780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068995840:0@lo:501: 00000100:00100000:3.0:1787758924.912094:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758924.912197:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccd8054d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787758924.912215:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068995840 00000100:00100000:3.0:1787758924.912219:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068995840 00000100:00100000:3.0:1787758924.912249:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787758924.912257:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601068995840:12345-0@lo:501: 00000100:00100000:3.0:1787758924.912435:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601068995840:12345-0@lo:501: Request processed in 178us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758924.912444:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787758924.912471:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1388780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068995840:0@lo:501: 00000100:00100000:2.0:1787758924.912510:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc6968f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068995968:0@lo:503: 00000100:00100000:2.0:1787758924.912553:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758924.912571:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfc9bfa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787758924.912574:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068995968 00000100:00100000:1.0:1787758924.912580:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068995968 00000100:00100000:1.0:1787758924.912612:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787758924.912657:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601068995968:12345-0@lo:503: 00000100:00100000:1.0:1787758924.913082:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601068995968:12345-0@lo:503: Request processed in 429us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758924.913094:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787758924.913121:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc6968f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068995968:0@lo:503: 00000100:00100000:3.0:1787758924.913332:0:7145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce138ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7145:1874601068996096:0@lo:502: 00000100:00100000:3.0:1787758924.913369:0:7145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758924.913395:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068996096 00000100:00100000:3.0:1787758924.913398:0:7145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc508c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787758924.913399:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068996096 00000100:00100000:2.0:1787758924.913425:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787758924.913430:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:7145:x1874601068996096:12345-0@lo:502: 00000100:00100000:2.0:1787758924.913695:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:7145:x1874601068996096:12345-0@lo:502: Request processed in 262us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758924.913703:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787758924.913711:0:7145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce138ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7145:1874601068996096:0@lo:502: 00000020:01000000:0.0:1787758924.913736:0:7145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787758924.913746:0:7145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758924.913749:0:7145:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787758924.913755:0:7145:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ccd06d3800 00000020:00000080:0.0:1787758924.913758:0:7145:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787758924.913782:0:7145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7145:1874601068996224:0@lo:502: 00000100:00100000:0.0:1787758924.913819:0:7145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758924.913845:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068996224 00000100:00100000:0.0:1787758924.913847:0:7145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc3130a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787758924.913850:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068996224 00000100:00100000:3.0:1787758924.913879:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787758924.913887:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:7145:x1874601068996224:12345-0@lo:502: 00000100:00100000:3.0:1787758924.914209:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:7145:x1874601068996224:12345-0@lo:502: Request processed in 322us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758924.914217:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787758924.914222:0:7145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7145:1874601068996224:0@lo:502: 00000020:01000000:0.0:1787758924.914248:0:7145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787758924.914254:0:7145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758924.914256:0:7145:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787758924.914261:0:7145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787758924.914355:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787758924.914383:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787758924.914394:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d126 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d12d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758924.914406:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d126 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d12d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758924.914417:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787758924.914420:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99ccc74c3490 from 1 10000000:01000000:1.0:1787758924.914424:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787758924.914448:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cd02046a00/0xa3b7f37aab2d134 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758924.914468:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99cd02046a00/0xa3b7f37aab2d134 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758924.914479:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99cd02046a00/0xa3b7f37aab2d134 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758924.914494:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1091a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068996352:0@lo:101: 00000100:00100000:1.0:1787758924.914532:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758924.914559:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc3426240 going to sleep for 11 seconds 00000100:00100000:1.0:1787758924.914577:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068996352 00000100:00100000:1.0:1787758924.914581:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068996352 00000100:00100000:1.0:1787758924.914659:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787758924.914671:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601068996352:12345-0@lo:101: 00010000:00010000:1.0:1787758924.914680:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758924.914692:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd02046400/0xa3b7f37aab2d13b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d134 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758924.914714:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd02046400/0xa3b7f37aab2d13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d134 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758924.914725:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd02046400/0xa3b7f37aab2d13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d134 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758924.914735:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd02046400, rc 0) 00000100:00100000:1.0:1787758924.914774:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:5818:x1874601068996352:12345-0@lo:101: Request processed in 108us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758924.914783:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787758924.914791:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1091a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068996352:0@lo:101: 00010000:00010000:0.0:1787758924.914803:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99cd02046a00/0xa3b7f37aab2d134 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d13b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758924.914811:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99cd02046a00/0xa3b7f37aab2d134 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d13b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758924.914855:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068996480:0@lo:501: 00000100:00100000:0.0:1787758924.914889:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758924.914914:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068996480 00000100:00100000:0.0:1787758924.914915:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc3130a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787758924.914924:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068996480 00000100:00100000:1.0:1787758924.914950:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787758924.914959:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:5818:x1874601068996480:12345-0@lo:501: 00000100:00100000:1.0:1787758924.915162:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:5818:x1874601068996480:12345-0@lo:501: Request processed in 206us (271us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787758924.915169:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787758924.915208:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601068996480:0@lo:501: 10000000:01000000:2.0:1787758924.915244:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787758924.915251:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cd02046a00/0xa3b7f37aab2d134 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d13b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758924.915266:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99cd02046a00/0xa3b7f37aab2d134 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d13b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787758924.919022:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787758924.919056:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787758924.919076:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1091a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1874601068996608:0@lo:13: 00000100:00100000:1.0:1787758924.919160:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758924.919200:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068996608 00000100:00100000:3.0:1787758924.919208:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068996608 00000004:00080000:1.0:1787758924.919224:0:7143:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787758924.919250:0:7143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7143:1874601068996736:0@lo:7: 00000100:00080000:0.0:1787758924.919261:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787758924.919268:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787758924.919279:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1092940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1874601068996608:12345-0@lo:13: 00000100:00100000:1.0:1787758924.919287:0:7143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758924.919311:0:7143:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc3426f00 going to sleep for 11 seconds 00002000:00000024:3.0:1787758924.919314:0:6672:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787758924.919319:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068996736 00000100:00100000:0.0:1787758924.919324:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068996736 00000100:00100000:0.0:1787758924.919357:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787758924.919366:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1090780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7143:x1874601068996736:12345-0@lo:7: 00000100:00100000:3.0:1787758924.919372:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1092940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1874601068996608:12345-0@lo:13: Request processed in 94us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758924.919380:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787758924.919396:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cce1091a40 x1874601068996608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758924.919414:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1091a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1874601068996608:0@lo:13: 00002000:00080000:0.0:1787758924.922819:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787758924.922826:0:6671:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787758924.922913:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1090780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7143:x1874601068996736:12345-0@lo:7: Request processed in 3546us (3624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758924.922924:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787758924.922946:0:7143:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cce1093c00 x1874601068996736/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787758940 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758924.922958:0:7143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7143:1874601068996736:0@lo:7: 00000004:00080000:1.0:1787758924.922971:0:7143:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787758924.923002:0:7143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7143:1874601068996864:0@lo:5: 00000100:00100000:1.0:1787758924.923029:0:7143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758924.923062:0:7144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068996864 00000100:00100000:1.0:1787758924.923066:0:7143:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc3426f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787758924.923067:0:7144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068996864 00000100:00100000:0.0:1787758924.923105:0:7144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787758924.923114:0:7144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce10921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7143:x1874601068996864:12345-0@lo:5: 00002000:00080000:0.0:1787758924.923140:0:7144:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787758924.923145:0:7144:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787758924.923329:0:7144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce10921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:7143:x1874601068996864:12345-0@lo:5: Request processed in 217us (299us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787758924.923334:0:7144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787758924.923353:0:7143:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cce1093c00 x1874601068996864/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787758940 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758924.923361:0:7143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7143:1874601068996864:0@lo:5: 00000004:00080000:1.0:1787758924.923367:0:7143:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787758924.923385:0:7143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1092d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7143:1874601068996992:0@lo:700: 00000100:00100000:1.0:1787758924.923410:0:7143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758924.923425:0:7143:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc3426f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787758924.923467:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068996992 00000100:00100000:2.0:1787758924.923473:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068996992 00000100:00100000:2.0:1787758924.923506:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787758924.923515:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7143:x1874601068996992:12345-0@lo:700: 00000100:00100000:2.0:1787758924.923548:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc6968f00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6677:1874601068997120:0@lo:700: 00000100:00100000:2.0:1787758924.923592:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758924.923613:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfc9bf540 going to sleep for 11 seconds 00000100:00100000:0.0:1787758924.923675:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068997120 00000100:00100000:0.0:1787758924.923680:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068997120 00000100:00100000:0.0:1787758924.923705:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787758924.923710:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc696b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6677:x1874601068997120:12345-0@lo:700: 40000000:02000000:2.0:1787758924.938146:0:5828:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787758924.942170:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc696b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6677:x1874601068997120:12345-0@lo:700: Request processed in 18448us (18576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758924.942195:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787758924.942212:0:6677:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ccc6968f00 x1874601068997120/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787758940 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758924.942233:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc6968f00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6677:1874601068997120:0@lo:700: 40000000:02000000:1.0:1787758924.942251:0:6677:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1787758924.962331:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1787758924.962363:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787758924.962417:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7143:x1874601068996992:12345-0@lo:700: Request processed in 38898us (38999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758924.962438:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787758924.962448:0:7143:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cce1092d00 x1874601068996992/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787758940 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758924.962461:0:7143:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787758924.962479:0:7143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1092d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7143:1874601068996992:0@lo:700: 00000004:02000040:2.0:1787758924.971174:0:7143:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1787758924.973119:0:7143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc6969a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7143:1874601068997248:0@lo:5: 00000100:00100000:2.0:1787758924.973170:0:7143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758924.973221:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068997248 00000100:00100000:2.0:1787758924.973223:0:7143:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfc9bf840 going to sleep for 11 seconds 00000100:00100000:1.0:1787758924.973228:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068997248 00000100:00100000:1.0:1787758924.973274:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787758924.973282:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6968780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7143:x1874601068997248:12345-0@lo:5: 00002000:00080000:1.0:1787758924.975987:0:6670:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787758924.975999:0:6670:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787758924.977189:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6968780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7143:x1874601068997248:12345-0@lo:5: Request processed in 3895us (4004us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787758924.977198:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787758924.977216:0:7143:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ccc6969a40 x1874601068997248/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787758940 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758924.977241:0:7143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc6969a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7143:1874601068997248:0@lo:5: 00000004:00080000:2.0:1787758924.977250:0:7143:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787758925.852761:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787758926.451932:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1787758926.876708:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758927.901717:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787758928.425155:0:7608:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787758928.425159:0:7608:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787758928.425258:0:7608:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99ccffe2e000 00000020:01000004:0.0:1787758928.425273:0:7608:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787758928.425284:0:7608:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787758928.425297:0:7608:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99ccf6071a48) 00000020:00000080:0.0:1787758928.425309:0:7608:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787758928.432097:0:7608:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787758928.432247:0:7608:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787758928.444764:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787758928.447423:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787758928.447442:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787758928.447475:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787758928.447497:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787758928.447818:0:7608:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787758928.447831:0:7608:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787758928.447840:0:7608:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa3b7f37aab2d149 00000020:01000004:1.0:1787758928.447847:0:7608:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787758928.447869:0:7608:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.154@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787758928.447872:0:7608:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787758928.447877:0:7608:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787758928.447897:0:7608:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787758928.447900:0:7608:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787758928.458933:0:7608:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.154@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787758928.458969:0:7608:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.154@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1787758928.458972:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787758928.458974:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787758928.458975:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787758928.458976:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787758928.458977:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787758928.458977:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787758928.458979:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787758928.458980:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787758928.458981:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787758928.458982:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787758928.458983:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787758928.458986:0:7608:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1787758928.458988:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787758928.458989:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787758928.458989:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787758928.458990:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787758928.458991:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787758928.458991:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787758928.458992:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787758928.458992:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787758928.458993:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787758928.458994:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787758928.458994:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787758928.459022:0:7608:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787758928.459043:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce10912c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068997376:0@lo:253: 00000100:00100000:1.0:1787758928.459126:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.459174:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc5319300 going to sleep for 11 seconds 00000100:00100000:2.0:1787758928.459197:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068997376 00000100:00100000:2.0:1787758928.459206:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068997376 00000100:00100000:2.0:1787758928.459258:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787758928.459269:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:7608:x1874601068997376:12345-0@lo:253: 20000000:01000000:2.0:1787758928.459307:0:5815:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787758928.459312:0:5815:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787758928.459319:0:5815:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787758928.459323:0:5815:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1787758928.460113:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787758928.460259:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787758928.460268:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1787758928.460293:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787758928.460298:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1787758928.460312:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787758928.460338:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787758928.460658:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787758928.460673:0:5815:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.154@tcp 20000000:01000000:2.0:1787758928.460674:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.154@tcp (null) (null) (null) 00000040:00080000:2.0:1787758928.460697:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787758928.460702:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787758928.460727:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787758928.460731:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.154@tcp (null) (null) 00000040:00080000:2.0:1787758928.460747:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787758928.460753:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787758928.460767:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787758928.460803:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787758928.461323:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1787758928.461332:0:5815:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.154@tcp 20000000:01000000:2.0:1787758928.461334:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.154@tcp (null) (null) (null) 00000040:00080000:2.0:1787758928.461353:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1787758928.461357:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787758928.461372:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1787758928.461376:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.154@tcp (null) (null) 00000040:00080000:2.0:1787758928.461390:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1787758928.461394:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787758928.461427:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1787758928.461471:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1787758928.461482:0:5815:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787758928.461485:0:5815:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787758928.461488:0:5815:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787758928.461509:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787758928.461511:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787758928.461536:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787758928.461538:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787758928.461949:0:7610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787758928.461976:0:7610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787758928.462006:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787758928.462165:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787758928.462191:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787758928.462209:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1787758928.462216:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787758928.462218:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787758928.462663:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787758928.462704:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787758928.462722:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787758928.462834:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787758928.462855:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787758928.462882:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1787758928.462889:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787758928.462890:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787758928.463081:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787758928.463159:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787758928.463178:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787758928.463204:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787758928.463210:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787758928.463211:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787758928.463439:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1787758928.463465:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1787758928.463493:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787758928.463598:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787758928.463639:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787758928.463682:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787758928.463691:0:5815:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1787758928.463693:0:5815:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1787758928.463699:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787758928.463718:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cd02047800/0xa3b7f37aab2d150 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.463731:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccc0031200/0xa3b7f37aab2d093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d08c expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.463737:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d0bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d0b6 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.463748:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cd02046e00/0xa3b7f37aab2d0e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d0e0 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.463753:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d0fc expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.463757:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cd02046400/0xa3b7f37aab2d13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d134 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.463761:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cd02047800/0xa3b7f37aab2d150 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.463784:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cd02046400/0xa3b7f37aab2d13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d134 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.463794:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cd02046400/0xa3b7f37aab2d13b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d134 expref: 16 pid: 5815 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.463801:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1092d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874601068997504:0@lo:104: 00000100:00100000:1.0:1787758928.463833:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787758928.463865:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d0fc expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.463872:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d103 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0fc expref: 16 pid: 5815 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.463878:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1091e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874601068997632:0@lo:104: 00000100:00100000:2.0:1787758928.463878:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068997504 00000100:00100000:2.0:1787758928.463885:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068997504 00000100:00100000:1.0:1787758928.463900:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787758928.463920:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cd02046e00/0xa3b7f37aab2d0e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d0e0 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758928.463930:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1787758928.463933:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cd02046e00/0xa3b7f37aab2d0e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0e0 expref: 16 pid: 5816 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.463942:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1090f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874601068997760:0@lo:104: 00000100:00100000:3.0:1787758928.463951:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068997632 00000100:00100000:2.0:1787758928.463956:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787758928.463958:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068997632 00000100:00100000:1.0:1787758928.463965:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758928.463970:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1093c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+4:5815:x1874601068997504:12345-0@lo:104: 00010000:00010000:2.0:1787758928.463984:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99cd02046a00/0xa3b7f37aab2d134 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d13b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758928.463992:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068997760 00000100:00100000:3.0:1787758928.463997:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068997760 00010000:00010000:1.0:1787758928.463998:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d0bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d0b6 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758928.464002:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787758928.464011:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d0bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0b6 expref: 16 pid: 5816 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758928.464019:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7839850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:5815:x1874601068997632:12345-0@lo:104: 00000100:00100000:1.0:1787758928.464022:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfae1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874601068997888:0@lo:104: 00010000:00010000:0.0:1787758928.464035:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd000/0xa3b7f37aab2d0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d103 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.464046:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787758928.464051:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787758928.464059:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1093c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:5815:x1874601068997504:12345-0@lo:104: Request processed in 94us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758928.464067:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787758928.464076:0:6685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787758928.464077:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccc0031200/0xa3b7f37aab2d093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d08c expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.464085:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787758928.464085:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068997888 00010000:00010000:1.0:1787758928.464086:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ccc0031200/0xa3b7f37aab2d093 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d08c expref: 16 pid: 5816 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758928.464090:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068997888 00010000:00010000:3.0:1787758928.464092:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99cd02046a00/0xa3b7f37aab2d134 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d13b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758928.464094:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7839850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:5815:x1874601068997632:12345-0@lo:104: Request processed in 79us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.464102:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874601068998016:0@lo:104: 00000100:00100000:2.0:1787758928.464108:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787758928.464114:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd02046a00 already unused, calling callback (ffffffffc1c61c20) 00000100:00100000:0.0:1787758928.464119:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787758928.464119:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1091a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:5815:x1874601068997760:12345-0@lo:104: 10000000:00010000:3.0:1787758928.464121:0:6685:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99cd02046a00/0xa3b7f37aab2d134 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d13b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.464130:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99ccd96fcc00/0xa3b7f37aab2d0e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d0e7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.464131:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787758928.464141:0:6685:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99cd02046a00/0xa3b7f37aab2d134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d13b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.464144:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8a26a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787758928.464166:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1092d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874601068997504:0@lo:104: 10000000:00010000:3.0:1787758928.464166:0:6685:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99cd02046a00/0xa3b7f37aab2d134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d13b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758928.464170:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068998016 00000100:00100000:0.0:1787758928.464177:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068998016 00010000:00010000:2.0:1787758928.464177:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:01000000:3.0:1787758928.464179:0:6685:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787758928.464180:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1091e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874601068997632:0@lo:104: 00000100:00100000:2.0:1787758928.464188:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1091a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:5815:x1874601068997760:12345-0@lo:104: Request processed in 67us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.464196:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1090f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874601068997760:0@lo:104: 00000100:00100000:2.0:1787758928.464197:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787758928.464205:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787758928.464211:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfaed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+4:5815:x1874601068997888:12345-0@lo:104: 00000100:00100000:2.0:1787758928.464215:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787758928.464219:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d0b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d0bd expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758928.464222:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+4:5815:x1874601068998016:12345-0@lo:104: 00010000:00010000:3.0:1787758928.464224:0:6685:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99cd02046a00/0xa3b7f37aab2d134 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d13b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.464230:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99ccd96fce00/0xa3b7f37aab2d08c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d093 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.464234:0:6685:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787758928.464258:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1787758928.464259:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99cd02046a00/0xa3b7f37aab2d134 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d13b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.464264:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787758928.464266:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfaed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+4:5815:x1874601068997888:12345-0@lo:104: Request processed in 53us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.464270:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfae1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874601068997888:0@lo:104: 00000100:00100000:2.0:1787758928.464273:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+4:5815:x1874601068998016:12345-0@lo:104: Request processed in 50us (143us total) trans 0 rc 0/0 00010000:00010000:3.0:1787758928.464282:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99cd02046a00/0xa3b7f37aab2d134 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d13b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758928.464285:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787758928.464286:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1874601068998016:0@lo:104: 00000100:00100000:2.0:1787758928.464301:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1787758928.464310:0:6685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787758928.464315:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd000/0xa3b7f37aab2d0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d103 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.464321:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccd96fd000 already unused, calling callback (ffffffffc1c61c20) 00010000:00010000:2.0:1787758928.464325:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:00010000:3.0:1787758928.464325:0:6685:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd000/0xa3b7f37aab2d0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d103 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758928.464329:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1389e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601068998144:0@lo:103: 00010000:00010000:1.0:1787758928.464331:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cd02047800/0xa3b7f37aab2d150 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.464333:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99ccd96fcc00/0xa3b7f37aab2d0e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d0e7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.464344:0:6685:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd000/0xa3b7f37aab2d0fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d103 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.464356:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccd96fcc00 already unused, calling callback (ffffffffc1c61c20) 10000000:00010000:3.0:1787758928.464360:0:6685:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd000/0xa3b7f37aab2d0fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d103 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787758928.464362:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99ccd96fcc00/0xa3b7f37aab2d0e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d0e7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758928.464371:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1787758928.464376:0:6685:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787758928.464378:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99ccd96fcc00/0xa3b7f37aab2d0e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d0e7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787758928.464393:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99ccd96fcc00/0xa3b7f37aab2d0e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d0e7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758928.464399:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787758928.464401:0:6685:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd000/0xa3b7f37aab2d0fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d103 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.464410:0:6685:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787758928.464411:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068998144 00000100:00100000:1.0:1787758928.464416:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068998144 00010000:00010000:2.0:1787758928.464419:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99ccd96fcc00/0xa3b7f37aab2d0e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d0e7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.464425:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd000/0xa3b7f37aab2d0fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d103 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.464427:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787758928.464428:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787758928.464437:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd000/0xa3b7f37aab2d0fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d103 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.464440:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cd02046400/0xa3b7f37aab2d13b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d134 expref: 17 pid: 5815 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.464448:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99ccd96fcc00/0xa3b7f37aab2d0e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d0e7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.464456:0:6685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787758928.464458:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99ccd96fcc00/0xa3b7f37aab2d0e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d0e7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.464462:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99ccd96fce00/0xa3b7f37aab2d08c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d093 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.464475:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787758928.464479:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccd96fce00 already unused, calling callback (ffffffffc1c61c20) 00010000:00010000:2.0:1787758928.464482:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1787758928.464484:0:6685:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99ccd96fce00/0xa3b7f37aab2d08c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d093 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.464487:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758928.464488:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc9722c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:3290:x1874601068998144:12345-0@lo:103: 00010000:00010000:2.0:1787758928.464491:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758928.464501:0:6685:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99ccd96fce00/0xa3b7f37aab2d08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d093 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.464506:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787758928.464506:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc6969680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601068998400:0@lo:103: 10000000:00010000:3.0:1787758928.464514:0:6685:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99ccd96fce00/0xa3b7f37aab2d08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d093 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.464515:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cd02046400/0xa3b7f37aab2d13b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d134 expref: 17 pid: 5815 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.464532:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787758928.464533:0:6685:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787758928.464539:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cd02046400/0xa3b7f37aab2d13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d134 expref: 17 pid: 5815 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.464541:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d0b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d0bd expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758928.464548:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787758928.464557:0:6685:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99ccd96fce00/0xa3b7f37aab2d08c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d093 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.464559:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cccf889c00 already unused, calling callback (ffffffffc1c61c20) 10000000:00010000:0.0:1787758928.464566:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d0b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d0bd expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.464567:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd02046400/0xa3b7f37aab2d13b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d134 expref: 17 pid: 5815 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.464569:0:6685:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787758928.464591:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99ccd96fce00/0xa3b7f37aab2d08c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d093 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.464600:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787758928.464602:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787758928.464636:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1389680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601068998528:0@lo:103: 00010000:00010000:3.0:1787758928.464644:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99ccd96fce00/0xa3b7f37aab2d08c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d093 expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.464657:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d0b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d0bd expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.464663:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc9722c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:3290:x1874601068998144:12345-0@lo:103: Request processed in 176us (292us total) trans 0 rc 0/0 00010000:00010000:3.0:1787758928.464663:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758928.464667:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1787758928.464671:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d0b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d0bd expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758928.464671:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787758928.464672:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787758928.464679:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787758928.464681:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787758928.464688:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce138a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3291:1874601068998272:0@lo:103: 00010000:00010000:0.0:1787758928.464698:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d0b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d0bd expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.464705:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787758928.464714:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d0b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d0bd expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.464721:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d0b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d0bd expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758928.464731:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.464733:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068998400 00000100:00100000:1.0:1787758928.464740:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068998400 00000100:00100000:2.0:1787758928.464742:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1367840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601068998656:0@lo:103: 00010000:00010000:0.0:1787758928.464745:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758928.464748:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758928.464750:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758928.464755:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758928.464759:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758928.464759:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cd02046e00/0xa3b7f37aab2d0e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0e0 expref: 16 pid: 5816 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758928.464775:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.464781:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068998528 00000100:00100000:3.0:1787758928.464782:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068998272 00000100:00100000:3.0:1787758928.464787:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068998272 00000100:00100000:0.0:1787758928.464792:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068998656 00000100:00100000:1.0:1787758928.464792:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068998528 00000100:00100000:0.0:1787758928.464798:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068998656 00000100:00100000:2.0:1787758928.464800:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1389e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601068998144:0@lo:103: 00010000:00010000:3.0:1787758928.464806:0:6686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d103 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0fc expref: 19 pid: 5815 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.464814:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccc0031200/0xa3b7f37aab2d093 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d08c expref: 19 pid: 5816 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.464818:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d0bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0b6 expref: 19 pid: 5816 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758928.464830:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787758928.464841:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc69683c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3292:x1874601068998400:12345-0@lo:103: 00000100:00100000:2.0:1787758928.464843:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787758928.464853:0:6686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787758928.464854:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787758928.464855:0:5807:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1787758928.464858:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce138b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3291:x1874601068998272:12345-0@lo:103: 00000100:00100000:0.0:1787758928.464864:0:5807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:3.0:1787758928.464864:0:6686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cd02046e00/0xa3b7f37aab2d0e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0e0 expref: 19 pid: 5816 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.464870:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6968000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3292:x1874601068998528:12345-0@lo:103: 00010000:00010000:2.0:1787758928.464871:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787758928.464883:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d103 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0fc expref: 19 pid: 5815 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.464885:0:6686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cd02046e00/0xa3b7f37aab2d0e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0e0 expref: 19 pid: 5816 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.464886:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787758928.464895:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccc0031200/0xa3b7f37aab2d093 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d08c expref: 19 pid: 5816 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.464913:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0fc expref: 19 pid: 5815 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.464928:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd02046e00/0xa3b7f37aab2d0e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d0e0 expref: 19 pid: 5816 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.464930:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccc0031200/0xa3b7f37aab2d093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d08c expref: 19 pid: 5816 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.464956:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d103 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d0fc expref: 18 pid: 5815 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.464959:0:6686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787758928.464961:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccc0031200/0xa3b7f37aab2d093 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d08c expref: 18 pid: 5816 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.464976:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787758928.464982:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787758928.465004:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc69683c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:3292:x1874601068998400:12345-0@lo:103: Request processed in 165us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.465021:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6968000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:3292:x1874601068998528:12345-0@lo:103: Request processed in 154us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758928.465023:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787758928.465029:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce138b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:3291:x1874601068998272:12345-0@lo:103: Request processed in 173us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.465036:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787758928.465044:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787758928.465051:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787758928.465062:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc696a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:3290:x1874601068998656:12345-0@lo:103: 00010000:00010000:3.0:1787758928.465070:0:6686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787758928.465075:0:6686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d0bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0b6 expref: 13 pid: 5816 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758928.465085:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1389680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601068998528:0@lo:103: 00010000:00010000:3.0:1787758928.465087:0:6686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d0bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0b6 expref: 13 pid: 5816 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758928.465099:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc6969680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601068998400:0@lo:103: 00010000:00010000:3.0:1787758928.465104:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d0bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d0b6 expref: 13 pid: 5816 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.465118:0:6686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cd02047800/0xa3b7f37aab2d150 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758928.465122:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce138a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3291:1874601068998272:0@lo:103: 00010000:00010000:3.0:1787758928.465129:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd02047800/0xa3b7f37aab2d150 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.465144:0:6686:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cd02047800/0xa3b7f37aab2d150 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.465152:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cd02047800/0xa3b7f37aab2d150 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.465160:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cd02047800/0xa3b7f37aab2d150 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.465167:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cd02047800/0xa3b7f37aab2d150 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.465182:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd02047800 already unused, calling callback (ffffffffc1666530) 00010000:00010000:3.0:1787758928.465187:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cd02047800/0xa3b7f37aab2d150 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.465195:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cd02047800/0xa3b7f37aab2d150 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.465210:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cd02047800/0xa3b7f37aab2d150 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.465220:0:6686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787758928.465223:0:5815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cd02047800/0xa3b7f37aab2d150 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.465232:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cd02047800/0xa3b7f37aab2d150 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.465240:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd02047800/0xa3b7f37aab2d150 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787758928.465254:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787758928.465254:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc696a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:3290:x1874601068998656:12345-0@lo:103: Request processed in 192us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758928.465264:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787758928.465269:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1367840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601068998656:0@lo:103: 00000100:00100000:2.0:1787758928.475975:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:7608:x1874601068997376:12345-0@lo:253: Request processed in 16699us (16838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.475981:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce10912c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068997376:0@lo:253: 00000100:00100000:2.0:1787758928.475992:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 10000000:01000000:1.0:1787758928.476002:0:7608:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787758928.476006:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787758928.476007:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787758928.476009:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787758928.476010:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787758928.476011:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787758928.476012:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787758928.476013:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787758928.476015:0:7608:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787758928.476016:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787758928.476017:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787758928.476035:0:7608:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99ccffe2e000 from lustre-OST0001 10000000:01000000:1.0:1787758928.476060:0:7608:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787758928.476063:0:7608:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787758928.476069:0:7608:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99ccc74c3490 local copy 10000000:01000000:1.0:1787758928.476072:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787758928.476103:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.476111:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.476117:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.476131:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068998784:0@lo:101: 00000100:00100000:1.0:1787758928.476158:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.476187:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8a26d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787758928.476194:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068998784 00000100:00100000:3.0:1787758928.476202:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068998784 00000100:00100000:3.0:1787758928.476241:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787758928.476250:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+11:7608:x1874601068998784:12345-0@lo:101: 00010000:00010000:3.0:1787758928.476265:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758928.476278:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccd96fce00/0xa3b7f37aab2d15e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d157 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.476301:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccd96fce00/0xa3b7f37aab2d15e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d157 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.476312:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccd96fce00/0xa3b7f37aab2d15e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d157 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.476322:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccd96fce00, rc 0) 00000100:00100000:3.0:1787758928.476363:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:7608:x1874601068998784:12345-0@lo:101: Request processed in 114us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758928.476371:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787758928.476372:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068998784:0@lo:101: 00010000:00010000:1.0:1787758928.476390:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d157 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa3b7f37aab2d15e expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.476412:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d157 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa3b7f37aab2d15e expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.476486:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068998912:0@lo:501: 00000100:00100000:1.0:1787758928.476509:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.476525:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8a26d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787758928.476546:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068998912 00000100:00100000:2.0:1787758928.476559:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068998912 00000100:00100000:2.0:1787758928.476598:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787758928.476606:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:7608:x1874601068998912:12345-0@lo:501: 00000100:00100000:2.0:1787758928.476857:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:7608:x1874601068998912:12345-0@lo:501: Request processed in 252us (346us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787758928.476866:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787758928.476869:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068998912:0@lo:501: 10000000:01000000:1.0:1787758928.476883:0:7608:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787758928.476902:0:7608:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787758928.476906:0:7608:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d157 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa3b7f37aab2d15e expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.476911:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d157 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa3b7f37aab2d15e expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.476916:0:7608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa3b7f37aab2d15e expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.476929:0:7608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787758928.476941:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99ccffe2e000 10000000:01000000:1.0:1787758928.476944:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787758928.476948:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787758928.476950:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787758928.476952:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787758928.476954:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787758928.476957:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787758928.476964:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cd02046400/0xa3b7f37aab2d165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.476966:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa3b7f37aab2d15e expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.476985:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99cd02046400/0xa3b7f37aab2d165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.476989:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd02047800 already unused, calling callback (ffffffffc1c61c20) 00010000:00010000:1.0:1787758928.476990:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99cd02046400/0xa3b7f37aab2d165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787758928.476995:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xa3b7f37aab2d15e expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.477000:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068999040:0@lo:101: 00010000:00010000:2.0:1787758928.477011:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa3b7f37aab2d15e expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787758928.477021:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa3b7f37aab2d15e expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.477025:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1787758928.477032:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787758928.477044:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8a26cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1787758928.477057:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d157 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa3b7f37aab2d15e expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758928.477063:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068999040 00000100:00100000:3.0:1787758928.477068:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068999040 00010000:00010000:2.0:1787758928.477078:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787758928.477096:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787758928.477104:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:7608:x1874601068999040:12345-0@lo:101: 00010000:00010000:2.0:1787758928.477106:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d157 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa3b7f37aab2d15e expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.477110:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc6969680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3291:1874601068999168:0@lo:103: 00010000:00010000:3.0:1787758928.477113:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758928.477122:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d157 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa3b7f37aab2d15e expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.477124:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccd96fd000/0xa3b7f37aab2d16c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d165 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.477137:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787758928.477142:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758928.477147:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758928.477151:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758928.477152:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccd96fd000/0xa3b7f37aab2d16c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d165 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.477162:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccd96fd000/0xa3b7f37aab2d16c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d165 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758928.477166:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068999168 00010000:00010000:3.0:1787758928.477170:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccd96fd000, rc 0) 00000100:00100000:0.0:1787758928.477181:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068999168 00000100:00100000:3.0:1787758928.477208:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:7608:x1874601068999040:12345-0@lo:101: Request processed in 102us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758928.477215:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787758928.477218:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068999040:0@lo:101: 00000100:00100000:0.0:1787758928.477225:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787758928.477234:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99cd02046400/0xa3b7f37aab2d165 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d16c expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758928.477236:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:3291:x1874601068999168:12345-0@lo:103: 00010000:00010000:1.0:1787758928.477250:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99cd02046400/0xa3b7f37aab2d165 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d16c expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.477251:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787758928.477264:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccd96fce00/0xa3b7f37aab2d15e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa3b7f37aab2d157 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.477272:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787758928.477304:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:3291:x1874601068999168:12345-0@lo:103: Request processed in 72us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.477309:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068999296:0@lo:501: 00000100:00100000:0.0:1787758928.477313:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787758928.477330:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc6969680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3291:1874601068999168:0@lo:103: 00000100:00100000:1.0:1787758928.477346:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.477364:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8a26cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758928.477368:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068999296 00000100:00100000:2.0:1787758928.477373:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068999296 00000100:00100000:2.0:1787758928.477399:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787758928.477407:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:7608:x1874601068999296:12345-0@lo:501: 00000100:00100000:2.0:1787758928.477515:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:7608:x1874601068999296:12345-0@lo:501: Request processed in 109us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758928.477521:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787758928.477536:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068999296:0@lo:501: 00000100:00100000:1.0:1787758928.477561:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068999424:0@lo:503: 00000100:00100000:1.0:1787758928.477613:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.477663:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8a26cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758928.477677:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068999424 00000100:00100000:3.0:1787758928.477682:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068999424 00000100:00100000:3.0:1787758928.477705:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787758928.477712:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:7608:x1874601068999424:12345-0@lo:503: 00000100:00100000:3.0:1787758928.477842:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:7608:x1874601068999424:12345-0@lo:503: Request processed in 130us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758928.477850:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787758928.477861:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068999424:0@lo:503: 00000040:00080000:1.0:1787758928.478101:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787758928.478169:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068999552:0@lo:502: 00000100:00100000:1.0:1787758928.478202:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.478218:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8a26cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758928.478246:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068999552 00000100:00100000:2.0:1787758928.478249:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068999552 00000100:00100000:2.0:1787758928.478266:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787758928.478270:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:7608:x1874601068999552:12345-0@lo:502: 00000100:00100000:2.0:1787758928.478360:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:7608:x1874601068999552:12345-0@lo:502: Request processed in 89us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758928.478368:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787758928.478380:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068999552:0@lo:502: 00000040:00080000:1.0:1787758928.478637:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787758928.478688:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787758928.478719:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787758928.478764:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787758928.478800:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787758928.478834:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787758928.478854:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068999680:0@lo:502: 00000100:00100000:1.0:1787758928.478885:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.478908:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8a26cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758928.478930:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068999680 00000100:00100000:3.0:1787758928.478939:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068999680 00000100:00100000:3.0:1787758928.478961:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787758928.478966:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:7608:x1874601068999680:12345-0@lo:502: 00000100:00100000:3.0:1787758928.479065:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:7608:x1874601068999680:12345-0@lo:502: Request processed in 98us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758928.479073:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787758928.479083:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068999680:0@lo:502: 00000040:00080000:1.0:1787758928.479158:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787758928.479166:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787758928.479478:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787758928.479487:0:7616:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787758928.479494:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787758928.479496:0:7616:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787758928.479501:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787758928.479523:0:7616:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99ccfcf21a48) 00000020:00000080:3.0:1787758928.479548:0:7616:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787758928.479554:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787758928.479651:0:7616:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ccffe2e000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787758928.479659:0:7616:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787758928.479668:0:7616:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa3b7f37aab2d17a 00010000:00010000:3.0:1787758928.482432:0:7616:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787758928.482685:0:7616:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787758928.484200:0:7616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787758928.484318:0:7616:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787758928.486597:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787758928.487102:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787758928.488600:0:7616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787758928.488611:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787758928.488640:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787758928.488643:0:7616:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787758928.488648:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787758928.488652:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787758928.488654:0:7616:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787758928.488658:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787758928.488665:0:7616:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787758928.488705:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787758928.488709:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787758928.488711:0:7616:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787758928.488715:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787758928.488794:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787758928.488821:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787758928.488839:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cd02046400/0xa3b7f37aab2d165 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d16c expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.488851:0:7608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99cd02046400/0xa3b7f37aab2d165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d16c expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758928.488860:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ccffe2e000 from 1 10000000:01000000:1.0:1787758928.488864:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787758928.488904:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cd02047a00/0xa3b7f37aab2d181 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.488911:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99cd02047a00/0xa3b7f37aab2d181 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.488921:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99cd02047a00/0xa3b7f37aab2d181 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.488941:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068999808:0@lo:101: 00000100:00100000:1.0:1787758928.489005:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758928.489050:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068999808 00000100:00100000:1.0:1787758928.489051:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8a26cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758928.489058:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068999808 00000100:00100000:3.0:1787758928.489106:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787758928.489116:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+12:7608:x1874601068999808:12345-0@lo:101: 00010000:00010000:3.0:1787758928.489129:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758928.489140:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccd96fd200/0xa3b7f37aab2d188 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d181 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.489163:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccd96fd200/0xa3b7f37aab2d188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d181 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.489174:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccd96fd200/0xa3b7f37aab2d188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d181 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.489184:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccd96fd200, rc 0) 00000100:00100000:3.0:1787758928.489231:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:7608:x1874601068999808:12345-0@lo:101: Request processed in 116us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758928.489238:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787758928.489266:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068999808:0@lo:101: 00010000:00010000:1.0:1787758928.489281:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99cd02047a00/0xa3b7f37aab2d181 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d188 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.489290:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99cd02047a00/0xa3b7f37aab2d181 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d188 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.489377:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068999936:0@lo:501: 00000100:00100000:1.0:1787758928.489409:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.489428:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8a26cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758928.489446:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601068999936 00000100:00100000:3.0:1787758928.489452:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601068999936 00000100:00100000:3.0:1787758928.489480:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787758928.489488:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:7608:x1874601068999936:12345-0@lo:501: 00000100:00100000:3.0:1787758928.489723:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:7608:x1874601068999936:12345-0@lo:501: Request processed in 236us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758928.489732:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787758928.489742:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601068999936:0@lo:501: 00000100:00100000:0.0:1787758928.489771:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1367840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069000064:0@lo:503: 00000100:00100000:0.0:1787758928.489803:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758928.489828:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069000064 00000100:00100000:0.0:1787758928.489830:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc5513480 going to sleep for 11 seconds 00000100:00100000:3.0:1787758928.489833:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069000064 00000100:00100000:3.0:1787758928.489862:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787758928.489870:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:7608:x1874601069000064:12345-0@lo:503: 00000100:00100000:3.0:1787758928.490172:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:7608:x1874601069000064:12345-0@lo:503: Request processed in 302us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758928.490179:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787758928.490210:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1367840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069000064:0@lo:503: 00000040:00080000:0.0:1787758928.490403:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787758928.490449:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1367840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069000192:0@lo:502: 00000100:00100000:0.0:1787758928.490477:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758928.490493:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc5513480 going to sleep for 11 seconds 00000100:00100000:3.0:1787758928.490512:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069000192 00000100:00100000:3.0:1787758928.490517:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069000192 00000100:00100000:3.0:1787758928.490543:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787758928.490550:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7468850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:7608:x1874601069000192:12345-0@lo:502: 00000100:00100000:3.0:1787758928.490716:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7468850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:7608:x1874601069000192:12345-0@lo:502: Request processed in 166us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758928.490724:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787758928.490733:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1367840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069000192:0@lo:502: 00000040:00080000:0.0:1787758928.490989:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787758928.491065:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787758928.491091:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1367840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069000320:0@lo:502: 00000100:00100000:0.0:1787758928.491120:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758928.491138:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc5513480 going to sleep for 11 seconds 00000100:00100000:3.0:1787758928.491153:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069000320 00000100:00100000:3.0:1787758928.491158:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069000320 00000100:00100000:3.0:1787758928.491188:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787758928.491196:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:7608:x1874601069000320:12345-0@lo:502: 00000100:00100000:3.0:1787758928.491309:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:7608:x1874601069000320:12345-0@lo:502: Request processed in 114us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758928.491317:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787758928.491327:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1367840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069000320:0@lo:502: 00000040:00080000:0.0:1787758928.491391:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787758928.491404:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787758928.491685:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787758928.491690:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758928.491692:0:7620:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787758928.491698:0:7620:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ccffe2e000 00000020:00000080:0.0:1787758928.491701:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787758928.491718:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787758928.491721:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758928.491723:0:7620:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787758928.491725:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787758928.491755:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787758928.491776:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787758928.491787:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cd02047a00/0xa3b7f37aab2d181 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d188 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.491793:0:7608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99cd02047a00/0xa3b7f37aab2d181 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d188 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758928.491829:0:7608:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787758928.491831:0:7608:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99ccffe2e000 10000000:01000000:1.0:1787758928.491834:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99ccffe2e000 10000000:01000000:1.0:1787758928.491837:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787758928.491840:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ccffe2e000 from 1 10000000:01000000:1.0:1787758928.491841:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787758928.491853:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d18f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.491858:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d18f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.491862:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d18f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.491870:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069000448:0@lo:101: 00000100:00100000:1.0:1787758928.491891:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.491909:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8a260c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758928.491926:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069000448 00000100:00100000:2.0:1787758928.491932:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069000448 00000100:00100000:2.0:1787758928.491965:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787758928.491974:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:7608:x1874601069000448:12345-0@lo:101: 00010000:00010000:2.0:1787758928.491982:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758928.491991:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d196 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d18f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.492007:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d18f expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.492016:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d18f expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758928.492024:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cccf889800, rc 0) 00000100:00100000:2.0:1787758928.492064:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:7608:x1874601069000448:12345-0@lo:101: Request processed in 91us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758928.492071:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787758928.492072:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069000448:0@lo:101: 00010000:00010000:1.0:1787758928.492085:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d18f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d196 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.492091:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d18f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d196 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.492123:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069000576:0@lo:501: 00000100:00100000:1.0:1787758928.492141:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.492161:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8a260c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758928.492176:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069000576 00000100:00100000:2.0:1787758928.492180:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069000576 00000100:00100000:2.0:1787758928.492205:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787758928.492212:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:7608:x1874601069000576:12345-0@lo:501: 00000100:00100000:2.0:1787758928.492394:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:7608:x1874601069000576:12345-0@lo:501: Request processed in 182us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758928.492404:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787758928.492418:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069000576:0@lo:501: 00000100:00100000:1.0:1787758928.492443:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069000704:0@lo:503: 00000100:00100000:1.0:1787758928.492468:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.492482:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8a260c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758928.492499:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069000704 00000100:00100000:2.0:1787758928.492504:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069000704 00000100:00100000:2.0:1787758928.492530:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787758928.492537:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:7608:x1874601069000704:12345-0@lo:503: 00000100:00100000:2.0:1787758928.492722:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:7608:x1874601069000704:12345-0@lo:503: Request processed in 184us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.492731:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069000704:0@lo:503: 00000100:00100000:2.0:1787758928.492740:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000040:00080000:1.0:1787758928.492887:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787758928.492920:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069000832:0@lo:502: 00000100:00100000:1.0:1787758928.492948:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.492976:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8a260c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758928.492976:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069000832 00000100:00100000:3.0:1787758928.492983:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069000832 00000100:00100000:3.0:1787758928.493012:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787758928.493020:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:7608:x1874601069000832:12345-0@lo:502: 00000100:00100000:3.0:1787758928.493187:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:7608:x1874601069000832:12345-0@lo:502: Request processed in 167us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.493193:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069000832:0@lo:502: 00000100:00100000:3.0:1787758928.493204:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000040:00080000:1.0:1787758928.493343:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787758928.493384:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787758928.493419:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787758928.493459:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787758928.493489:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787758928.493526:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787758928.493555:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787758928.493600:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787758928.493687:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787758928.493722:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787758928.493741:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787758928.493765:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787758928.493782:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787758928.493797:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787758928.493828:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787758928.493849:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787758928.493865:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787758928.493898:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787758928.493923:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787758928.493938:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787758928.493969:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787758928.493988:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787758928.494004:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787758928.494036:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787758928.494056:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787758928.494071:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787758928.494094:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787758928.494111:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1787758928.494126:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787758928.494148:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1787758928.494165:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1787758928.494181:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1787758928.494196:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1787758928.494229:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1787758928.494247:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1787758928.494281:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1787758928.494301:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1787758928.494313:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069000960:0@lo:502: 00000100:00100000:1.0:1787758928.494337:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.494354:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8a260c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758928.494370:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069000960 00000100:00100000:2.0:1787758928.494375:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069000960 00000100:00100000:2.0:1787758928.494400:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787758928.494406:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:7608:x1874601069000960:12345-0@lo:502: 00000100:00100000:2.0:1787758928.494529:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:7608:x1874601069000960:12345-0@lo:502: Request processed in 122us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758928.494537:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787758928.494540:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069000960:0@lo:502: 00000040:00080000:1.0:1787758928.494599:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1787758928.494605:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787758928.494849:0:7621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787758928.494861:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99ccf7131a48) 00000020:00000080:1.0:1787758928.494871:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1787758928.494923:0:7621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99ccffe2e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787758928.494927:0:7621:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99ccffe2e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787758928.494929:0:7621:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99ccffe2e000 3 00010000:00080000:1.0:1787758928.494960:0:7621:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99cbc5790000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.154@tcp at head 00010000:00010000:1.0:1787758928.496057:0:7621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1787758928.496176:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787758928.496193:0:7621:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787758928.496201:0:7621:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa3b7f37aab2d1a4 00000100:00080000:1.0:1787758928.496206:0:7621:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787758928.496211:0:7621:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99cbc5790000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:1.0:1787758928.496233:0:7621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccfcfac3c0 x1874601069001088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787758928.496250:0:7621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787758928.496275:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3289:1874601069001088:0@lo:38: 00000100:00100000:0.0:1787758928.496322:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758928.496381:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1388b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874601069001216:0@lo:400: 00000100:00100000:0.0:1787758928.496385:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069001088 00000100:00100000:0.0:1787758928.496390:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069001088 00000040:00080000:1.0:1787758928.496402:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1787758928.496423:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787758928.496424:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758928.496433:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1367840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3289:x1874601069001088:12345-0@lo:38: 00010000:00080000:0.0:1787758928.496455:0:5822:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 78 last 0 00000100:00100000:3.0:1787758928.496455:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787758928.496466:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce138ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1874601069001344:0@lo:400: 00000100:00080000:1.0:1787758928.496494:0:7622:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff99ccfcfacb40 x1874601069001600/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758928.496499:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1787758928.496500:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa3b7f37aab2d1ab 00000100:00100000:1.0:1787758928.496506:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8a26000 going to sleep for 0 seconds 00000004:00100000:0.0:1787758928.496520:0:5822:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1787758928.496541:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1388780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069001472:0@lo:400: 00000100:00080000:0.0:1787758928.496554:0:5822:0:(import.c:65:import_set_state_nolock()) ffff99ccfcfb9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787758928.496590:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758928.496692:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1367840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1874601069001088:12345-0@lo:38: Request processed in 257us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.496695:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069001472 00000100:00100000:1.0:1787758928.496699:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069001472 00000100:00100000:0.0:1787758928.496703:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787758928.496710:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069001216 00000100:00100000:3.0:1787758928.496715:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069001216 00000100:00100000:0.0:1787758928.496720:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069001344 00000100:00100000:0.0:1787758928.496725:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069001344 00000100:00100000:1.0:1787758928.496741:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787758928.496750:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce138a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069001472:12345-0@lo:400: 00000100:00100000:3.0:1787758928.496753:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787758928.496768:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787758928.496768:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce13883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874601069001216:12345-0@lo:400: 00000100:00100000:0.0:1787758928.496782:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce138b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874601069001344:12345-0@lo:400: 00000100:00100000:1.0:1787758928.496791:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce138a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069001472:12345-0@lo:400: Request processed in 43us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.496798:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787758928.496815:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787758928.496819:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787758928.496823:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce13883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874601069001216:12345-0@lo:400: Request processed in 60us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758928.496832:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787758928.496844:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cce1388780 x1874601069001472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758928.496846:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce138b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874601069001344:12345-0@lo:400: Request processed in 66us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.496860:0:3290:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787758928.496864:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787758928.496876:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1388780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069001472:0@lo:400: 00010000:00080000:3.0:1787758928.496878:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cce138ad00 x1874601069001344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758928.496897:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce138ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1874601069001344:0@lo:400: 00010000:00080000:0.0:1787758928.496902:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ccfcfac3c0 x1874601069001088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787758938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758928.496912:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00010000:00080000:3.0:1787758928.496914:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99cce1388b40 x1874601069001216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787758928.496919:0:3289:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00100000:3.0:1787758928.496926:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1388b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874601069001216:0@lo:400: 00000100:00080000:0.0:1787758928.496929:0:3289:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787758928.496935:0:3289:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787758928.496939:0:3289:0:(import.c:65:import_set_state_nolock()) ffff99cbc5790000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1787758928.496946:0:3289:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000046b1c095): req@ffff99ccfcfacb40 x1874601069001600/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758928.496965:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3289:1874601069001088:0@lo:38: 00000020:01000000:0.0:1787758928.496984:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787758928.497004:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:1.0:1787758928.497009:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787758928.497022:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d18f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d196 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.497034:0:7608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d18f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d196 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758928.497036:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069001600 00000100:00100000:1.0:1787758928.497040:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069001600 00000100:00080000:3.0:1787758928.497062:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787758928.497078:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:01000004:0.0:1787758928.497082:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787758928.497086:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000100:00100000:1.0:1787758928.497086:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7622:x1874601069001600:12345-0@lo:901: 00000020:01000004:0.0:1787758928.497089:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787758928.497092:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787758928.497094:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787758928.497096:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787758928.497097:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787758928.497099:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787758928.497105:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787758928.497106:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787758928.497107:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787758928.497111:0:7608:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787758928.497114:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787758928.497116:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787758928.497117:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787758928.497118:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787758928.497120:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787758928.497121:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787758928.497123:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787758928.497124:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787758928.497125:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787758928.497126:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787758928.497128:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787758928.497153:0:7608:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787758928.497162:0:7608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1365680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069001728:0@lo:253: 00000100:00100000:0.0:1787758928.497197:0:7608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758928.497228:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069001728 00000100:00100000:0.0:1787758928.497231:0:7608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc5513480 going to sleep for 11 seconds 00000100:00100000:3.0:1787758928.497233:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069001728 00000100:00100000:3.0:1787758928.497265:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787758928.497281:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:7608:x1874601069001728:12345-0@lo:253: 20000000:01000000:3.0:1787758928.497303:0:5815:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787758928.497318:0:5815:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787758928.497394:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7622:x1874601069001600:12345-0@lo:901: Request processed in 309us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758928.497403:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787758928.497434:0:7622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99ccfcfacb40 x1874601069001600/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787758944 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758928.497444:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfacb40 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7622:1874601069001600:0@lo:901: 20000000:01000000:1.0:1787758928.508508:0:5815:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787758928.508526:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787758928.508540:0:5837:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787758928.508546:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787758928.508593:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d1b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.508638:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cccf888400/0xa3b7f37aab2d0f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d0ee expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.508646:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d1b2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.508690:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cccf888400/0xa3b7f37aab2d0f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d0ee expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.508704:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cccf888400/0xa3b7f37aab2d0f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0ee expref: 14 pid: 5815 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758928.508719:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1388b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5837:1874601069001856:0@lo:104: 00000100:00100000:3.0:1787758928.508802:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758928.508844:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069001856 00000100:00100000:3.0:1787758928.508848:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc484d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758928.508854:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069001856 00000100:00100000:1.0:1787758928.508910:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787758928.508922:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce138ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+3:5837:x1874601069001856:12345-0@lo:104: 00010000:00010000:1.0:1787758928.508938:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d0ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d0f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758928.509018:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787758928.509026:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce138ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+3:5837:x1874601069001856:12345-0@lo:104: Request processed in 106us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758928.509030:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1388b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5837:1874601069001856:0@lo:104: 00010000:00010000:0.0:1787758928.509038:0:6685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787758928.509038:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787758928.509049:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d0ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d0f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.509051:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d1b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.509069:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccd96fd800 already unused, calling callback (ffffffffc1c61c20) 10000000:00010000:0.0:1787758928.509075:0:6685:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d0ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d0f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.509085:0:6685:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d0ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d0f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758928.509093:0:6685:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d0ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d0f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758928.509100:0:6685:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787758928.509138:0:6685:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d0ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d0f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.509155:0:6685:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787758928.509184:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d0ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d0f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.509192:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d0ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d0f5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758928.509193:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce13643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3291:1874601069001984:0@lo:103: 00010000:00010000:0.0:1787758928.509220:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758928.509223:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758928.509226:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758928.509235:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758928.509269:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069001984 00000100:00100000:0.0:1787758928.509274:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069001984 00010000:00010000:0.0:1787758928.509295:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cccf888400/0xa3b7f37aab2d0f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0ee expref: 15 pid: 5815 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758928.509329:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787758928.509339:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1388b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:3291:x1874601069001984:12345-0@lo:103: 00010000:00010000:0.0:1787758928.509352:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787758928.509357:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cccf888400/0xa3b7f37aab2d0f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0ee expref: 15 pid: 5815 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.509371:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cccf888400/0xa3b7f37aab2d0f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0ee expref: 15 pid: 5815 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.509386:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cccf888400/0xa3b7f37aab2d0f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d0ee expref: 15 pid: 5815 timeout: 228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.509402:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d1b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.509422:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d1b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787758928.509437:0:5808:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001310059s 00010000:00010000:0.0:1787758928.509442:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d1b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.509450:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d1b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.509458:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d1b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.509466:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d1b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.509472:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccd96fc600 already unused, calling callback (ffffffffc1666530) 00010000:00010000:0.0:1787758928.509477:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d1b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.509488:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d1b2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.509502:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d1b2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.509509:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d1b2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758928.509513:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787758928.509525:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d1b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758928.509532:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d1b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758928.509555:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1388b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:3291:x1874601069001984:12345-0@lo:103: Request processed in 218us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758928.509564:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787758928.509597:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce13643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3291:1874601069001984:0@lo:103: 00000100:00100000:0.0:1787758928.511167:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:7608:x1874601069001728:12345-0@lo:253: Request processed in 13887us (13967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758928.511176:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787758928.511204:0:7608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1365680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:7608:1874601069001728:0@lo:253: 10000000:01000000:2.0:1787758928.511218:0:7608:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787758928.511222:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787758928.511224:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787758928.511225:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787758928.511226:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787758928.511228:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787758928.511229:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787758928.511231:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787758928.511233:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787758928.511234:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787758928.511237:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787758928.511238:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787758928.511252:0:7608:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787758928.514077:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787758928.514219:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787758928.514373:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787758928.514485:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787758928.514711:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1787758928.514829:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787758928.515518:0:7608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787758928.589319:0:7608:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787758928.589331:0:7608:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787758928.589406:0:7608:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787758928.589486:0:7608:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787758928.589507:0:7608:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787758928.589546:0:7608:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787758928.925712:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758929.948689:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758930.077882:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc6969e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1874601069002112:0@lo:13: 00000100:00100000:0.0:1787758930.077955:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758930.077994:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069002112 00000100:00100000:2.0:1787758930.078001:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069002112 00000100:00080000:0.0:1787758930.078039:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787758930.078064:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787758930.078078:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce13661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874601069002112:12345-0@lo:13: 00002000:00000024:2.0:1787758930.078110:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787758930.078159:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce13661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874601069002112:12345-0@lo:13: Request processed in 85us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758930.078166:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787758930.078195:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccc6969e00 x1874601069002112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758930.078213:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc6969e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1874601069002112:0@lo:13: 00000001:02000400:0.0:1787758930.473395:0:7963:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787758930.972752:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787758931.228753:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787758931.228762:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ccc782b000 from 30 10000000:01000000:3.0:1787758931.228768:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787758931.228813:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccd96fc600/0xa3b7f37aab2d1b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758931.228825:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99ccd96fc600/0xa3b7f37aab2d1b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758931.228836:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99ccd96fc600/0xa3b7f37aab2d1b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758931.228860:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1389680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069002240:0@lo:101: 00000100:00100000:3.0:1787758931.228925:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758931.228992:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc3125e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787758931.228994:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069002240 00000100:00100000:2.0:1787758931.229001:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069002240 00000100:00100000:2.0:1787758931.229055:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787758931.229061:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:5818:x1874601069002240:12345-0@lo:101: 00010000:00010000:2.0:1787758931.229071:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758931.229082:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cccf888c00/0xa3b7f37aab2d1c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d1b9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758931.229103:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cccf888c00/0xa3b7f37aab2d1c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d1b9 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758931.229111:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cccf888c00/0xa3b7f37aab2d1c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d1b9 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758931.229117:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cccf888c00, rc 0) 00000100:00100000:2.0:1787758931.229148:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:5818:x1874601069002240:12345-0@lo:101: Request processed in 88us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758931.229153:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787758931.229189:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1389680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069002240:0@lo:101: 00010000:00010000:3.0:1787758931.229202:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99ccd96fc600/0xa3b7f37aab2d1b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d1c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758931.229211:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99ccd96fc600/0xa3b7f37aab2d1b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d1c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758931.229281:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1389680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069002368:0@lo:501: 00000100:00100000:3.0:1787758931.229307:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758931.229323:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc3125e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787758931.229358:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069002368 00000100:00100000:0.0:1787758931.229363:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069002368 00000100:00100000:0.0:1787758931.229389:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787758931.229394:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:5818:x1874601069002368:12345-0@lo:501: 00000100:00100000:0.0:1787758931.229710:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:5818:x1874601069002368:12345-0@lo:501: Request processed in 315us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758931.229716:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787758931.229745:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1389680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069002368:0@lo:501: 00000100:00100000:3.0:1787758931.229773:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1389680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069002496:0@lo:503: 00000100:00100000:3.0:1787758931.229807:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758931.229830:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc3125e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787758931.229842:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069002496 00000100:00100000:2.0:1787758931.229846:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069002496 00000100:00100000:2.0:1787758931.229866:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787758931.229873:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:5818:x1874601069002496:12345-0@lo:503: 00000100:00100000:2.0:1787758931.230095:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:5818:x1874601069002496:12345-0@lo:503: Request processed in 224us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758931.230108:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787758931.230129:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1389680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069002496:0@lo:503: 00000100:00100000:3.0:1787758931.230387:0:8067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1389680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8067:1874601069002624:0@lo:502: 00000100:00100000:3.0:1787758931.230416:0:8067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758931.230431:0:8067:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc31253c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787758931.230454:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069002624 00000100:00100000:0.0:1787758931.230459:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069002624 00000100:00100000:0.0:1787758931.230484:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787758931.230488:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:8067:x1874601069002624:12345-0@lo:502: 00000100:00100000:0.0:1787758931.230681:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:8067:x1874601069002624:12345-0@lo:502: Request processed in 192us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758931.230686:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787758931.230717:0:8067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1389680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8067:1874601069002624:0@lo:502: 00000100:00100000:3.0:1787758931.230755:0:8067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1389680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8067:1874601069002752:0@lo:502: 00000100:00100000:3.0:1787758931.230784:0:8067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758931.230805:0:8067:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc31253c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758931.230819:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069002752 00000100:00100000:2.0:1787758931.230824:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069002752 00000100:00100000:2.0:1787758931.230843:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787758931.230847:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:8067:x1874601069002752:12345-0@lo:502: 00000100:00100000:2.0:1787758931.230939:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:8067:x1874601069002752:12345-0@lo:502: Request processed in 90us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758931.230946:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787758931.230972:0:8067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1389680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8067:1874601069002752:0@lo:502: 00000040:00080000:3.0:1787758931.230992:0:8067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787758931.231063:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787758931.231077:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787758931.231082:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccd96fc600/0xa3b7f37aab2d1b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d1c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.231089:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99ccd96fc600/0xa3b7f37aab2d1b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d1c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758931.231095:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787758931.231096:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787758931.231104:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787758931.231116:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccc0031000/0xa3b7f37aab2d1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.231121:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99ccc0031000/0xa3b7f37aab2d1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.231125:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99ccc0031000/0xa3b7f37aab2d1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758931.231133:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069002880:0@lo:101: 00000100:00100000:0.0:1787758931.231152:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758931.231166:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc55130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758931.231197:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069002880 00000100:00100000:1.0:1787758931.231203:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069002880 00000100:00100000:1.0:1787758931.231238:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787758931.231253:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:5818:x1874601069002880:12345-0@lo:101: 00010000:00010000:1.0:1787758931.231262:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758931.231272:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd02046a00/0xa3b7f37aab2d1ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d1c7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758931.231289:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd02046a00/0xa3b7f37aab2d1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d1c7 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758931.231298:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd02046a00/0xa3b7f37aab2d1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d1c7 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758931.231305:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd02046a00, rc 0) 00000100:00100000:1.0:1787758931.231343:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601069002880:12345-0@lo:101: Request processed in 93us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758931.231351:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787758931.231369:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069002880:0@lo:101: 00010000:00010000:0.0:1787758931.231388:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99ccc0031000/0xa3b7f37aab2d1c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d1ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.231394:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99ccc0031000/0xa3b7f37aab2d1c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d1ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758931.231420:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069003008:0@lo:501: 00000100:00100000:0.0:1787758931.231437:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758931.231449:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc55130c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758931.231475:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069003008 00000100:00100000:2.0:1787758931.231479:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069003008 00000100:00100000:2.0:1787758931.231497:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787758931.231501:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601069003008:12345-0@lo:501: 00000100:00100000:2.0:1787758931.231637:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601069003008:12345-0@lo:501: Request processed in 111us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758931.231642:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069003008:0@lo:501: 00000100:00100000:2.0:1787758931.231647:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787758931.231666:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069003136:0@lo:503: 00000100:00100000:0.0:1787758931.231693:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758931.231710:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc55130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758931.231735:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069003136 00000100:00100000:1.0:1787758931.231740:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069003136 00000100:00100000:1.0:1787758931.231768:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787758931.231776:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601069003136:12345-0@lo:503: 00000100:00100000:1.0:1787758931.232056:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601069003136:12345-0@lo:503: Request processed in 281us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758931.232064:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787758931.232076:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069003136:0@lo:503: 00000100:00100000:2.0:1787758931.232297:0:8068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc696ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8068:1874601069003264:0@lo:502: 00000100:00100000:2.0:1787758931.232321:0:8068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758931.232334:0:8068:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd323600 going to sleep for 11 seconds 00000100:00100000:3.0:1787758931.232360:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069003264 00000100:00100000:3.0:1787758931.232365:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069003264 00000100:00100000:3.0:1787758931.232391:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787758931.232398:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:8068:x1874601069003264:12345-0@lo:502: 00000100:00100000:3.0:1787758931.232574:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:8068:x1874601069003264:12345-0@lo:502: Request processed in 175us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758931.232590:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787758931.232605:0:8068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc696ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8068:1874601069003264:0@lo:502: 00000020:01000000:2.0:1787758931.232644:0:8068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787758931.232651:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758931.232653:0:8068:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787758931.232655:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787758931.232657:0:8068:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787758931.232667:0:8068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc696ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8068:1874601069003392:0@lo:502: 00000100:00100000:2.0:1787758931.232690:0:8068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758931.232710:0:8068:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd323600 going to sleep for 11 seconds 00000100:00100000:1.0:1787758931.232738:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069003392 00000100:00100000:1.0:1787758931.232743:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069003392 00000100:00100000:1.0:1787758931.232769:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787758931.232778:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:8068:x1874601069003392:12345-0@lo:502: 00000100:00100000:1.0:1787758931.232894:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:8068:x1874601069003392:12345-0@lo:502: Request processed in 117us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758931.232909:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787758931.232935:0:8068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc696ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8068:1874601069003392:0@lo:502: 00000020:01000000:2.0:1787758931.232957:0:8068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787758931.232963:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758931.232965:0:8068:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787758931.232968:0:8068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787758931.233018:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787758931.233028:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787758931.233032:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccc0031000/0xa3b7f37aab2d1c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d1ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.233037:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99ccc0031000/0xa3b7f37aab2d1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d1ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758931.233042:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787758931.233043:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ccd06d3800 from 30 10000000:01000000:0.0:1787758931.233045:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787758931.233054:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccc0031200/0xa3b7f37aab2d1d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.233065:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99ccc0031200/0xa3b7f37aab2d1d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.233070:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99ccc0031200/0xa3b7f37aab2d1d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758931.233077:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069003520:0@lo:101: 00000100:00100000:0.0:1787758931.233094:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758931.233106:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc55130c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758931.233128:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069003520 00000100:00100000:3.0:1787758931.233134:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069003520 00000100:00100000:3.0:1787758931.233160:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787758931.233169:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601069003520:12345-0@lo:101: 00010000:00010000:3.0:1787758931.233175:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758931.233184:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccd96fd400/0xa3b7f37aab2d1dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d1d5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758931.233198:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccd96fd400/0xa3b7f37aab2d1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d1d5 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758931.233206:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccd96fd400/0xa3b7f37aab2d1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d1d5 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758931.233214:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccd96fd400, rc 0) 00000100:00100000:3.0:1787758931.233246:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:5818:x1874601069003520:12345-0@lo:101: Request processed in 79us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758931.233254:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787758931.233265:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069003520:0@lo:101: 00010000:00010000:0.0:1787758931.233278:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99ccc0031200/0xa3b7f37aab2d1d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d1dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.233286:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99ccc0031200/0xa3b7f37aab2d1d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d1dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758931.233308:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069003648:0@lo:501: 00000100:00100000:0.0:1787758931.233323:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758931.233334:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc55130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758931.233367:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069003648 00000100:00100000:1.0:1787758931.233372:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069003648 00000100:00100000:1.0:1787758931.233398:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787758931.233406:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:5818:x1874601069003648:12345-0@lo:501: 00000100:00100000:1.0:1787758931.233550:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:5818:x1874601069003648:12345-0@lo:501: Request processed in 145us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758931.233558:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787758931.233562:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069003648:0@lo:501: 00000100:00100000:0.0:1787758931.233582:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069003776:0@lo:503: 00000100:00100000:0.0:1787758931.233605:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758931.233659:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069003776 00000100:00100000:0.0:1787758931.233662:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc55130c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758931.233664:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069003776 00000100:00100000:3.0:1787758931.233690:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787758931.233696:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:5818:x1874601069003776:12345-0@lo:503: 00000100:00100000:3.0:1787758931.233795:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:5818:x1874601069003776:12345-0@lo:503: Request processed in 98us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758931.233803:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787758931.233813:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069003776:0@lo:503: 00000100:00100000:3.0:1787758931.234004:0:8069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1389680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8069:1874601069003904:0@lo:502: 00000100:00100000:3.0:1787758931.234042:0:8069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758931.234058:0:8069:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc3125780 going to sleep for 11 seconds 00000100:00100000:1.0:1787758931.234074:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069003904 00000100:00100000:1.0:1787758931.234078:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069003904 00000100:00100000:1.0:1787758931.234097:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787758931.234108:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:8069:x1874601069003904:12345-0@lo:502: 00000100:00100000:1.0:1787758931.234220:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:8069:x1874601069003904:12345-0@lo:502: Request processed in 112us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758931.234225:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787758931.234248:0:8069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1389680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8069:1874601069003904:0@lo:502: 00000100:00100000:3.0:1787758931.234280:0:8069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1389680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8069:1874601069004032:0@lo:502: 00000100:00100000:3.0:1787758931.234312:0:8069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758931.234329:0:8069:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc3125780 going to sleep for 11 seconds 00000100:00100000:2.0:1787758931.234344:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069004032 00000100:00100000:2.0:1787758931.234350:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069004032 00000100:00100000:2.0:1787758931.234374:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787758931.234379:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:8069:x1874601069004032:12345-0@lo:502: 00000100:00100000:2.0:1787758931.234477:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:8069:x1874601069004032:12345-0@lo:502: Request processed in 98us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758931.234483:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787758931.234504:0:8069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1389680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8069:1874601069004032:0@lo:502: 00000040:00080000:3.0:1787758931.234524:0:8069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787758931.234594:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787758931.234607:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787758931.234611:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccc0031200/0xa3b7f37aab2d1d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d1dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.234643:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99ccc0031200/0xa3b7f37aab2d1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d1dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758931.234648:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787758931.234649:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99ccd06d3800 from 5 10000000:01000000:0.0:1787758931.234650:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787758931.234661:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccc0030800/0xa3b7f37aab2d1e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.234666:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99ccc0030800/0xa3b7f37aab2d1e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.234671:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99ccc0030800/0xa3b7f37aab2d1e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758931.234678:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069004160:0@lo:101: 00000100:00100000:0.0:1787758931.234704:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758931.234726:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc55130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758931.234736:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069004160 00000100:00100000:1.0:1787758931.234741:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069004160 00000100:00100000:1.0:1787758931.234767:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787758931.234776:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:5818:x1874601069004160:12345-0@lo:101: 00010000:00010000:1.0:1787758931.234783:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758931.234792:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd02046e00/0xa3b7f37aab2d1ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d1e3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758931.234806:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd02046e00/0xa3b7f37aab2d1ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d1e3 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758931.234813:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd02046e00/0xa3b7f37aab2d1ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d1e3 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758931.234822:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd02046e00, rc 0) 00000100:00100000:1.0:1787758931.234846:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069004160:12345-0@lo:101: Request processed in 72us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758931.234854:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787758931.234869:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069004160:0@lo:101: 00010000:00010000:0.0:1787758931.234886:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99ccc0030800/0xa3b7f37aab2d1e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d1ea expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.234895:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99ccc0030800/0xa3b7f37aab2d1e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d1ea expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758931.234933:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069004288:0@lo:256: 00000100:00100000:0.0:1787758931.234979:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758931.234997:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc55130c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758931.235015:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069004288 00000100:00100000:2.0:1787758931.235020:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069004288 00000100:00100000:2.0:1787758931.235040:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787758931.235045:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7420050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069004288:12345-0@lo:256: 20000000:01000000:2.0:1787758931.235056:0:5816:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787758931.235069:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787758931.235071:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787758931.235139:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7420050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069004288:12345-0@lo:256: Request processed in 93us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758931.235145:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787758931.235167:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069004288:0@lo:256: 10000000:01000000:0.0:1787758931.235206:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787758931.235212:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccc0030800/0xa3b7f37aab2d1e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d1ea expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.235219:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99ccc0030800/0xa3b7f37aab2d1e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d1ea expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758931.235225:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787758931.235227:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787758931.235230:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787758931.235243:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccc0030e00/0xa3b7f37aab2d1f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.235251:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99ccc0030e00/0xa3b7f37aab2d1f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.235258:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99ccc0030e00/0xa3b7f37aab2d1f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758931.235269:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069004416:0@lo:101: 00000100:00100000:0.0:1787758931.235292:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758931.235308:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc55130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758931.235326:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069004416 00000100:00100000:1.0:1787758931.235330:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069004416 00000100:00100000:1.0:1787758931.235355:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787758931.235363:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7420c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069004416:12345-0@lo:101: 00010000:00010000:1.0:1787758931.235370:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758931.235377:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d1f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d1f1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758931.235386:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d1f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d1f1 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758931.235391:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d1f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d1f1 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758931.235395:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd02047400, rc 0) 00000100:00100000:1.0:1787758931.235431:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7420c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069004416:12345-0@lo:101: Request processed in 69us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758931.235439:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787758931.235452:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069004416:0@lo:101: 00010000:00010000:0.0:1787758931.235461:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99ccc0030e00/0xa3b7f37aab2d1f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d1f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.235474:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99ccc0030e00/0xa3b7f37aab2d1f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d1f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758931.235503:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069004544:0@lo:501: 00000100:00100000:0.0:1787758931.235537:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758931.235555:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc55130c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787758931.235573:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069004544 00000100:00100000:2.0:1787758931.235578:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069004544 00000100:00100000:2.0:1787758931.235602:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787758931.235609:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7422050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069004544:12345-0@lo:501: 00000100:00100000:2.0:1787758931.235757:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7422050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069004544:12345-0@lo:501: Request processed in 149us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758931.235767:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787758931.235777:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069004544:0@lo:501: 00000100:00100000:0.0:1787758931.235802:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069004672:0@lo:503: 00000100:00100000:0.0:1787758931.235834:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758931.235856:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc55130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758931.235875:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069004672 00000100:00100000:1.0:1787758931.235880:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069004672 00000100:00100000:1.0:1787758931.235901:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787758931.235908:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7423c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069004672:12345-0@lo:503: 00000100:00100000:1.0:1787758931.236141:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7423c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069004672:12345-0@lo:503: Request processed in 233us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758931.236163:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787758931.236171:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1365a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069004672:0@lo:503: 00000100:00100000:2.0:1787758931.236375:0:8070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc696ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8070:1874601069004800:0@lo:502: 00000100:00100000:2.0:1787758931.236409:0:8070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758931.236427:0:8070:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd323300 going to sleep for 11 seconds 00000100:00100000:3.0:1787758931.236444:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069004800 00000100:00100000:3.0:1787758931.236449:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069004800 00000100:00100000:3.0:1787758931.236473:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787758931.236480:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7421c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:8070:x1874601069004800:12345-0@lo:502: 00000100:00100000:3.0:1787758931.236745:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7421c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:8070:x1874601069004800:12345-0@lo:502: Request processed in 265us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758931.236753:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787758931.236759:0:8070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc696ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8070:1874601069004800:0@lo:502: 00000020:01000000:2.0:1787758931.236781:0:8070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787758931.236787:0:8070:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787758931.236793:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758931.236795:0:8070:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787758931.236800:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787758931.236804:0:8070:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.154@tcp to nid 0x20000c0a8c99a (192.168.201.154@tcp) 00000020:01000000:2.0:1787758931.236830:0:8070:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787758931.236834:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787758931.236848:0:8070:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99cbc55d1a48) 00000020:00000080:2.0:1787758931.236864:0:8070:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787758931.236867:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787758931.236923:0:8070:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787758931.236927:0:8070:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787758931.236931:0:8070:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa3b7f37aab2d206 00010000:00080000:2.0:1787758931.236952:0:8070:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99ccfd10e800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.154@tcp at head 00010000:00010000:2.0:1787758931.237134:0:8070:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787758931.237374:0:8070:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787758931.237381:0:8070:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787758931.237849:0:8070:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787758931.237982:0:8070:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787758931.238035:0:8070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787758931.238113:0:8070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787758931.238362:0:8071:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787758931.238367:0:8071:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787758931.238713:0:8070:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787758931.238718:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787758931.238734:0:8070:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787758931.238745:0:8070:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa3b7f37aab2d20d 00000100:00080000:2.0:1787758931.238750:0:8070:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787758931.238754:0:8070:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99ccfd10e800 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:2.0:1787758931.238770:0:8070:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99ccc696ad00 x1874601069004928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787758931.238787:0:8070:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787758931.238833:0:3289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc696ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3289:1874601069004928:0@lo:8: 00000020:01000000:2.0:1787758931.238840:0:8070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787758931.238846:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758931.238848:0:8070:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787758931.238852:0:8070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787758931.238856:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758931.238858:0:8070:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787758931.238863:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787758931.238865:0:8070:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787758931.238877:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874601069005056:0@lo:400: 00000100:00100000:0.0:1787758931.238878:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758931.238884:0:8070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc6968f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8070:1874601069005184:0@lo:502: 00000100:00100000:2.0:1787758931.238924:0:8070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758931.238931:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758931.238936:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1874601069005312:0@lo:400: 00000100:00100000:0.0:1787758931.238937:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1874601069005568:0@lo:400: 00000100:00100000:2.0:1787758931.238941:0:8070:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc35ed900 going to sleep for 11 seconds 00000100:00100000:2.0:1787758931.238976:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069005056 00000100:00100000:2.0:1787758931.238981:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069005056 00000100:00100000:1.0:1787758931.238985:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758931.238992:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069004928 00000100:00100000:0.0:1787758931.238997:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069004928 00000100:00100000:3.0:1787758931.239018:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069005312 00000100:00100000:1.0:1787758931.239023:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787758931.239023:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787758931.239025:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069005312 00000100:00100000:0.0:1787758931.239029:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787758931.239037:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069005440:0@lo:400: 00000100:00100000:2.0:1787758931.239039:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1389680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874601069005056:12345-0@lo:400: 00000100:00100000:0.0:1787758931.239050:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1365a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3289:x1874601069004928:12345-0@lo:8: 00000100:00100000:3.0:1787758931.239066:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787758931.239076:0:6671:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 81 last 0 00000100:00100000:3.0:1787758931.239080:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1874601069005312:12345-0@lo:400: 00000100:00100000:1.0:1787758931.239083:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758931.239088:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1389680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874601069005056:12345-0@lo:400: Request processed in 53us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758931.239094:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:00000080:0.0:1787758931.239108:0:6671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa3b7f37aab2d214 00002000:00100000:0.0:1787758931.239121:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99ccfcfb8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787758931.239126:0:6671:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787758931.239130:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787758931.239135:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069005184 00010000:00080000:2.0:1787758931.239141:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccfcfacb40 x1874601069005056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758931.239142:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069005184 00000100:00100000:3.0:1787758931.239148:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfaf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1874601069005312:12345-0@lo:400: Request processed in 70us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758931.239159:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787758931.239173:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874601069005056:0@lo:400: 00000100:00100000:1.0:1787758931.239179:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787758931.239190:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7421450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:8070:x1874601069005184:12345-0@lo:502: 00002000:00100000:0.0:1787758931.239223:0:6671:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787758931.239408:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7421450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:8070:x1874601069005184:12345-0@lo:502: Request processed in 219us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758931.239417:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787758931.239423:0:8070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc6968f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8070:1874601069005184:0@lo:502: 00000020:01000000:2.0:1787758931.239444:0:8070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787758931.239448:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758931.239449:0:8070:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787758931.239452:0:8070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00002000:00080000:0.0:1787758931.239454:0:6671:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1787758931.239459:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069005440 00000100:00100000:1.0:1787758931.239464:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069005440 00000100:00080000:0.0:1787758931.239476:0:6671:0:(import.c:65:import_set_state_nolock()) ffff99ccfcfbc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787758931.239498:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000020:01000000:3.0:1787758931.239507:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000100:00100000:1.0:1787758931.239510:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069005440:12345-0@lo:400: 00000100:00100000:0.0:1787758931.239523:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1365a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3289:x1874601069004928:12345-0@lo:8: Request processed in 484us (645us total) trans 0 rc 0/0 10000000:01000000:3.0:1787758931.239541:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:0.0:1787758931.239544:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787758931.239555:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccc0030e00/0xa3b7f37aab2d1f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d1f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787758931.239562:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787758931.239568:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99ccc0030e00/0xa3b7f37aab2d1f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d1f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758931.239570:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069005440:12345-0@lo:400: Request processed in 63us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758931.239579:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1787758931.239588:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 00000100:00100000:1.0:1787758931.239589:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:3.0:1787758931.239593:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99ccc74c3490 from 1 10000000:01000000:3.0:1787758931.239597:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:2.0:1787758931.239604:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069005568 00000100:00100000:2.0:1787758931.239608:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069005568 00010000:00010000:3.0:1787758931.239647:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d21b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1787758931.239649:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccc696ad00 x1874601069004928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787758941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787758931.239665:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d21b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758931.239668:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787758931.239669:0:3289:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00010000:00080000:1.0:1787758931.239673:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccfcfac000 x1874601069005440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787758931.239680:0:3289:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00010000:00010000:3.0:1787758931.239683:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d21b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758931.239684:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874601069005568:12345-0@lo:400: 00000100:00080000:0.0:1787758931.239689:0:3289:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787758931.239698:0:3289:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787758931.239702:0:3289:0:(import.c:65:import_set_state_nolock()) ffff99ccfd10e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787758931.239705:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069005440:0@lo:400: 00000100:00100000:3.0:1787758931.239712:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1388780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069005696:0@lo:101: 00000004:00080000:0.0:1787758931.239714:0:3289:0:(osp_dev.c:1648:osp_import_event()) got connected 00010000:00080000:1.0:1787758931.239720:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccfcfad2c0 x1874601069005312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758931.239722:0:3289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc696ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3289:1874601069004928:0@lo:8: 00000100:00100000:2.0:1787758931.239737:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874601069005568:12345-0@lo:400: Request processed in 57us (159us total) trans 0 rc 0/0 00000100:00080000:0.0:1787758931.239742:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787758931.239753:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787758931.239754:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758931.239761:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1874601069005312:0@lo:400: 00010000:00080000:0.0:1787758931.239762:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccfcfaf480 x1874601069005568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787758947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758931.239771:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1874601069005568:0@lo:400: 00000004:00080000:2.0:1787758931.239778:0:8071:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787758931.239796:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069005696 00000100:00100000:3.0:1787758931.239798:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc3125780 going to sleep for 11 seconds 00000100:00100000:0.0:1787758931.239799:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069005696 00000100:00100000:3.0:1787758931.239835:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787758931.239847:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7421850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069005696:12345-0@lo:101: 00000004:00080000:2.0:1787758931.239855:0:8071:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 81514237631ns, next at 0ns, rc = 0 00010000:00010000:3.0:1787758931.239855:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758931.239867:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccd96fce00/0xa3b7f37aab2d222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d21b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758931.239886:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccd96fce00/0xa3b7f37aab2d222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d21b expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758931.239905:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccd96fce00/0xa3b7f37aab2d222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d21b expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758931.239913:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccd96fce00, rc 0) 00000100:00100000:3.0:1787758931.239958:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7421850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069005696:12345-0@lo:101: Request processed in 115us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758931.239965:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787758931.239989:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1388780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069005696:0@lo:101: 00010000:00010000:0.0:1787758931.240004:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d21b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d222 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.240015:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d21b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d222 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758931.240066:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1364780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069005824:0@lo:501: 00000100:00100000:0.0:1787758931.240093:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758931.240116:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc55130c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758931.240124:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069005824 00000100:00100000:1.0:1787758931.240128:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069005824 00000100:00100000:1.0:1787758931.240154:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787758931.240184:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7421050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069005824:12345-0@lo:501: 00000100:00100000:1.0:1787758931.240364:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7421050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069005824:12345-0@lo:501: Request processed in 203us (270us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787758931.240371:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787758931.240381:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1364780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069005824:0@lo:501: 10000000:01000000:0.0:1787758931.240415:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787758931.240420:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d21b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d222 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758931.240425:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d21b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d222 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787758931.247866:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787758931.254230:0:8072:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787758931.254252:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1364780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069005952:0@lo:13: 00000100:00100000:0.0:1787758931.254254:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1364f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8072:1874601069006080:0@lo:7: 00000100:00100000:0.0:1787758931.254323:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758931.254324:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758931.254352:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069006080 00000100:00100000:1.0:1787758931.254358:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069006080 00000100:00100000:3.0:1787758931.254365:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069005952 00000100:00100000:3.0:1787758931.254372:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069005952 00000100:00100000:0.0:1787758931.254374:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc55136c0 going to sleep for 11 seconds 00000100:00080000:0.0:1787758931.254392:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787758931.254412:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787758931.254418:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787758931.254423:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1365e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8072:x1874601069006080:12345-0@lo:7: 00000100:00100000:3.0:1787758931.254434:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6968f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1874601069005952:12345-0@lo:13: 00002000:00000024:3.0:1787758931.254458:0:6672:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787758931.254511:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6968f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1874601069005952:12345-0@lo:13: Request processed in 82us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758931.254519:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787758931.254538:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cce1364780 x1874601069005952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758931.254560:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1364780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069005952:0@lo:13: 00002000:00080000:1.0:1787758931.257091:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787758931.257095:0:6671:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787758931.257132:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1365e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8072:x1874601069006080:12345-0@lo:7: Request processed in 2713us (2815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758931.257138:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787758931.257168:0:8072:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cce1364f00 x1874601069006080/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787758947 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758931.257180:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1364f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8072:1874601069006080:0@lo:7: 00000004:00080000:0.0:1787758931.257188:0:8072:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787758931.257206:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1364f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8072:1874601069006208:0@lo:5: 00000100:00100000:0.0:1787758931.257230:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758931.257249:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069006208 00000100:00100000:1.0:1787758931.257253:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069006208 00000100:00100000:0.0:1787758931.257258:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc55136c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758931.257280:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787758931.257286:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1364780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8072:x1874601069006208:12345-0@lo:5: 00002000:00080000:1.0:1787758931.257298:0:6669:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787758931.257301:0:6669:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787758931.257417:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1364780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8072:x1874601069006208:12345-0@lo:5: Request processed in 131us (185us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787758931.257425:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787758931.257454:0:8072:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cce1364f00 x1874601069006208/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787758947 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758931.257477:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1364f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8072:1874601069006208:0@lo:5: 00000004:00080000:0.0:1787758931.257485:0:8072:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787758931.257504:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce13670c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8072:1874601069006336:0@lo:700: 00000100:00100000:0.0:1787758931.257541:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758931.257558:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc55136c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758931.257578:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069006336 00000100:00100000:3.0:1787758931.257583:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069006336 00000100:00100000:3.0:1787758931.257613:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787758931.257653:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce13652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8072:x1874601069006336:12345-0@lo:700: 00000100:00100000:3.0:1787758931.257681:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1388780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6677:1874601069006464:0@lo:700: 00000100:00100000:3.0:1787758931.257713:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758931.257742:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc3125600 going to sleep for 11 seconds 00000100:00100000:2.0:1787758931.257743:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069006464 00000100:00100000:2.0:1787758931.257748:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069006464 00000100:00100000:2.0:1787758931.257776:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787758931.257781:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6677:x1874601069006464:12345-0@lo:700: 40000000:02000000:0.0:1787758931.264483:0:5828:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787758931.267825:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6677:x1874601069006464:12345-0@lo:700: Request processed in 10041us (10108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758931.267833:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787758931.267870:0:6677:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cce1388780 x1874601069006464/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787758947 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758931.267884:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1388780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6677:1874601069006464:0@lo:700: 40000000:02000000:3.0:1787758931.267895:0:6677:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:1.0:1787758931.284692:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787758931.284711:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1787758931.284758:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce13652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8072:x1874601069006336:12345-0@lo:700: Request processed in 27104us (27212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758931.284776:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787758931.284780:0:8072:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cce13670c0 x1874601069006336/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787758947 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758931.284793:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce13670c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8072:1874601069006336:0@lo:700: 00000004:02000040:3.0:1787758931.291774:0:8072:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1787758931.293603:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1388780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8072:1874601069006592:0@lo:5: 00000100:00100000:3.0:1787758931.293684:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758931.293711:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069006592 00000100:00100000:2.0:1787758931.293720:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069006592 00000100:00100000:3.0:1787758931.293730:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc3125540 going to sleep for 11 seconds 00000100:00100000:2.0:1787758931.293757:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787758931.293765:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5881e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8072:x1874601069006592:12345-0@lo:5: 00002000:00080000:2.0:1787758931.296334:0:6670:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787758931.296348:0:6670:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787758931.297576:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5881e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8072:x1874601069006592:12345-0@lo:5: Request processed in 3811us (3892us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787758931.297583:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787758931.297609:0:8072:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cce1388780 x1874601069006592/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787758947 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758931.297644:0:8072:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787758931.297662:0:8072:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff99cce1388780 x1874601069006592/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787758947 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758931.297671:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1388780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8072:1874601069006592:0@lo:5: 00000004:00080000:3.0:1787758931.297682:0:8072:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1787758931.996737:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787758932.703796:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1787758932.835032:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758932.835089:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062695040 00000100:00100000:3.0:1787758932.835097:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062695040 00000100:00100000:3.0:1787758932.835126:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 104 00000100:00100000:3.0:1787758932.835134:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7422c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2355:x1874601062695040:12345-192.168.201.54@tcp:250: 00010000:00080000:3.0:1787758932.835160:0:5816:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 5453e3da-9a83-4395-adba-03dea8a5243b@192.168.201.54@tcp t0 exp 0000000000000000 cur 83 last 0 00000020:00000080:3.0:1787758932.835181:0:5816:0:(genops.c:1385:class_connect()) connect: client 5453e3da-9a83-4395-adba-03dea8a5243b, cookie 0xa3b7f37aab2d229 00000100:00080000:3.0:1787758932.835296:0:5816:0:(import.c:65:import_set_state_nolock()) ffff99cbc557a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787758932.835344:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7422c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+5:2355:x1874601062695040:12345-192.168.201.54@tcp:250: Request processed in 211us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758932.835350:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 104 00000100:00100000:3.0:1787758932.835943:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758932.835975:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062695168 00000100:00100000:1.0:1787758932.835981:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062695168 00000100:00100000:1.0:1787758932.836010:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 105 00000100:00100000:1.0:1787758932.836016:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7420450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+5:5574:x1874601062695168:12345-192.168.201.54@tcp:101: 00010000:00010000:1.0:1787758932.836024:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758932.836036:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd02046200/0xa3b7f37aab2d230 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ab477154fea86eb expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758932.836053:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd02046200/0xa3b7f37aab2d230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86eb expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758932.836061:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd02046200/0xa3b7f37aab2d230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86eb expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758932.836067:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd02046200, rc 0) 00000100:00100000:1.0:1787758932.836091:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7420450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+6:5574:x1874601062695168:12345-192.168.201.54@tcp:101: Request processed in 75us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758932.836098:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 105 00000100:00100000:1.0:1787758932.836700:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758932.836724:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062695296 00000100:00100000:3.0:1787758932.836729:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062695296 00000100:00100000:3.0:1787758932.836749:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 106 00000100:00100000:3.0:1787758932.836754:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7423450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+6:5574:x1874601062695296:12345-192.168.201.54@tcp:501: 00000100:00100000:3.0:1787758932.836990:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7423450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+6:5574:x1874601062695296:12345-192.168.201.54@tcp:501: Request processed in 234us (289us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787758932.836995:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 106 00000100:00100000:2.0:1787758932.837690:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758932.837715:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062695424 00000100:00100000:1.0:1787758932.837719:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062695424 00000100:00100000:1.0:1787758932.837748:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 107 00000100:00100000:1.0:1787758932.837757:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7420850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+6:5574:x1874601062695424:12345-192.168.201.54@tcp:101: 00010000:00010000:1.0:1787758932.837765:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758932.837774:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cd02046000/0xa3b7f37aab2d237 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ab477154fea86f2 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758932.837800:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cd02046000/0xa3b7f37aab2d237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86f2 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758932.837812:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cd02046000/0xa3b7f37aab2d237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86f2 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758932.837817:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cd02046000, rc 0) 00000100:00100000:1.0:1787758932.837842:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7420850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+7:5574:x1874601062695424:12345-192.168.201.54@tcp:101: Request processed in 89us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758932.837846:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 107 00000100:00100000:0.0:1787758932.838451:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758932.838478:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062695552 00000100:00100000:3.0:1787758932.838482:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062695552 00000100:00100000:3.0:1787758932.838516:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 108 00000100:00100000:3.0:1787758932.838522:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7422850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+7:5574:x1874601062695552:12345-192.168.201.54@tcp:501: 00000100:00100000:3.0:1787758932.838652:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7422850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+8:5574:x1874601062695552:12345-192.168.201.54@tcp:501: Request processed in 130us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758932.838658:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 108 00000100:00100000:2.0:1787758932.839231:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758932.839261:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062695680 00000100:00100000:1.0:1787758932.839265:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062695680 00000100:00100000:1.0:1787758932.839286:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 109 00000100:00100000:1.0:1787758932.839290:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7423850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+8:5574:x1874601062695680:12345-192.168.201.54@tcp:503: 00000100:00100000:1.0:1787758932.839551:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7423850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+8:5574:x1874601062695680:12345-192.168.201.54@tcp:503: Request processed in 259us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758932.839556:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 109 00000100:00100000:2.0:1787758932.840530:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758932.840565:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062695808 00000100:00100000:3.0:1787758932.840571:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062695808 00000100:00100000:3.0:1787758932.840599:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 110 00000100:00100000:3.0:1787758932.840607:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7422450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+8:5593:x1874601062695808:12345-192.168.201.54@tcp:502: 00000100:00100000:3.0:1787758932.840841:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7422450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+8:5593:x1874601062695808:12345-192.168.201.54@tcp:502: Request processed in 233us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758932.840849:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 110 00000100:00100000:0.0:1787758932.847995:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758932.848027:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062695936 00000100:00100000:1.0:1787758932.848035:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062695936 00000100:00100000:1.0:1787758932.848070:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 111 00000100:00100000:1.0:1787758932.848077:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7423050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+8:5593:x1874601062695936:12345-192.168.201.54@tcp:502: 00000100:00100000:1.0:1787758932.848262:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7423050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+8:5593:x1874601062695936:12345-192.168.201.54@tcp:502: Request processed in 185us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758932.848269:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 111 00000100:00100000:2.0:1787758932.852150:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758932.852177:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062696064 00000100:00100000:3.0:1787758932.852182:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062696064 00000100:00100000:3.0:1787758932.852205:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 112 00000100:00100000:3.0:1787758932.852211:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+8:5574:x1874601062696064:12345-192.168.201.54@tcp:101: 00010000:00010000:3.0:1787758932.852225:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758932.852238:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccd96fcc00/0xa3b7f37aab2d23e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ab477154fea871c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758932.852257:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccd96fcc00/0xa3b7f37aab2d23e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea871c expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758932.852264:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccd96fcc00/0xa3b7f37aab2d23e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea871c expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758932.852271:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccd96fcc00, rc 0) 00000100:00100000:3.0:1787758932.852295:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+9:5574:x1874601062696064:12345-192.168.201.54@tcp:101: Request processed in 85us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758932.852299:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 112 00000100:00100000:2.0:1787758932.853315:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758932.853351:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062696192 00000100:00100000:1.0:1787758932.853355:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062696192 00000100:00100000:1.0:1787758932.853376:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 113 00000100:00100000:1.0:1787758932.853381:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+9:5574:x1874601062696192:12345-192.168.201.54@tcp:256: 20000000:01000000:1.0:1787758932.853400:0:5815:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787758932.853413:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787758932.853417:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787758932.853420:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787758932.853422:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787758932.853920:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+9:5574:x1874601062696192:12345-192.168.201.54@tcp:256: Request processed in 537us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758932.853928:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 113 00000100:00100000:2.0:1787758932.855327:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758932.855364:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062696320 00000100:00100000:3.0:1787758932.855369:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062696320 00000100:00100000:3.0:1787758932.855391:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 114 00000100:00100000:3.0:1787758932.855396:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+9:5574:x1874601062696320:12345-192.168.201.54@tcp:101: 00010000:00010000:3.0:1787758932.855402:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758932.855409:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccd96fc800/0xa3b7f37aab2d245 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8723 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758932.855426:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccd96fc800/0xa3b7f37aab2d245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8723 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758932.855432:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccd96fc800/0xa3b7f37aab2d245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8723 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758932.855437:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccd96fc800, rc 0) 00000100:00100000:3.0:1787758932.855465:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:5574:x1874601062696320:12345-192.168.201.54@tcp:101: Request processed in 69us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758932.855470:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 114 00000100:00100000:2.0:1787758932.856062:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758932.856093:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062696448 00000100:00100000:1.0:1787758932.856098:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062696448 00000100:00100000:1.0:1787758932.856124:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 115 00000100:00100000:1.0:1787758932.856129:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+10:5574:x1874601062696448:12345-192.168.201.54@tcp:501: 00000100:00100000:1.0:1787758932.856296:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+10:5574:x1874601062696448:12345-192.168.201.54@tcp:501: Request processed in 166us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758932.856301:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 115 00000100:00100000:0.0:1787758932.856803:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758932.856832:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062696576 00000100:00100000:3.0:1787758932.856838:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062696576 00000100:00100000:3.0:1787758932.856859:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 116 00000100:00100000:3.0:1787758932.856865:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:5574:x1874601062696576:12345-192.168.201.54@tcp:503: 00000100:00100000:3.0:1787758932.857077:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:5574:x1874601062696576:12345-192.168.201.54@tcp:503: Request processed in 212us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758932.857082:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 116 00000100:00100000:2.0:1787758932.857758:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758932.857810:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062696704 00000100:00100000:1.0:1787758932.857815:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062696704 00000100:00100000:1.0:1787758932.857843:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 117 00000100:00100000:1.0:1787758932.857850:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+10:5595:x1874601062696704:12345-192.168.201.54@tcp:502: 00000100:00100000:1.0:1787758932.857954:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+10:5595:x1874601062696704:12345-192.168.201.54@tcp:502: Request processed in 105us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758932.857959:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 117 00000100:00100000:2.0:1787758932.858469:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758932.858490:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062696832 00000100:00100000:3.0:1787758932.858494:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062696832 00000100:00100000:3.0:1787758932.858526:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 118 00000100:00100000:3.0:1787758932.858532:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:5595:x1874601062696832:12345-192.168.201.54@tcp:502: 00000100:00100000:3.0:1787758932.858607:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:5595:x1874601062696832:12345-192.168.201.54@tcp:502: Request processed in 76us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758932.858612:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 118 00000100:00100000:0.0:1787758932.859348:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758932.859377:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062696960 00000100:00100000:3.0:1787758932.859382:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062696960 00000100:00100000:3.0:1787758932.859414:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:3.0:1787758932.859420:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1365680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2355:x1874601062696960:12345-192.168.201.54@tcp:38: 00010000:00080000:3.0:1787758932.859438:0:5821:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 33089637-5953-4edf-8e89-39ecfabcd268@192.168.201.54@tcp t0 exp 0000000000000000 cur 83 last 0 00000020:00000080:3.0:1787758932.859476:0:5821:0:(genops.c:1385:class_connect()) connect: client 33089637-5953-4edf-8e89-39ecfabcd268, cookie 0xa3b7f37aab2d24c 00000004:00100000:3.0:1787758932.859511:0:5821:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787758932.859516:0:5821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787758932.865301:0:5821:0:(import.c:65:import_set_state_nolock()) ffff99ccfd109800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787758932.865338:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1365680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+6:2355:x1874601062696960:12345-192.168.201.54@tcp:38: Request processed in 5918us (5991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758932.865344:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 4 00010000:00010000:0.0:1787758933.020739:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787758933.865944:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758933.865986:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758933.866022:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062697216 00000100:00100000:0.0:1787758933.866047:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062697088 00000100:00100000:3.0:1787758933.866052:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062697216 00000100:00100000:0.0:1787758933.866053:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062697088 00000100:00080000:1.0:1787758933.866127:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787758933.866135:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:0.0:1787758933.866147:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:3.0:1787758933.866150:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc696bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+7:5574:x1874601062697216:12345-192.168.201.54@tcp:41: 00000100:00100000:0.0:1787758933.866161:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc696ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+7:0:x1874601062697088:12345-192.168.201.54@tcp:41: 00000004:00000024:0.0:1787758933.866204:0:5823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000004:00000024:3.0:1787758933.866205:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787758933.866287:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc696ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+7:0:x1874601062697088:12345-192.168.201.54@tcp:41: Request processed in 128us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758933.866288:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc696bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+7:5574:x1874601062697216:12345-192.168.201.54@tcp:41: Request processed in 139us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758933.866303:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:0.0:1787758933.866315:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:0.0:1787758933.867131:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758933.867164:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062697344 00000100:00100000:2.0:1787758933.867169:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062697344 00000100:00100000:2.0:1787758933.867197:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:2.0:1787758933.867202:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce13643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+6:5574:x1874601062697344:12345-192.168.201.54@tcp:40: 00000100:00100000:2.0:1787758933.867239:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce13643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+6:5574:x1874601062697344:12345-192.168.201.54@tcp:40: Request processed in 37us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758933.867245:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:1.0:1787758933.868139:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758933.868167:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758933.868197:0:7144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062697472 00000100:00100000:2.0:1787758933.868203:0:7144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062697472 00000100:00100000:1.0:1787758933.868207:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758933.868231:0:7144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062697728 00000100:00100000:2.0:1787758933.868234:0:7144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062697728 00000100:00100000:1.0:1787758933.868250:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758933.868250:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:0.0:1787758933.868263:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062697600 00000100:00100000:2.0:1787758933.868263:0:7144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:3.0:1787758933.868264:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1874601062697472:12345-192.168.201.54@tcp:8: 00000100:00100000:0.0:1787758933.868271:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062697600 00000100:00100000:2.0:1787758933.868277:0:7144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1874601062697728:12345-192.168.201.54@tcp:8: 00010000:00080000:3.0:1787758933.868298:0:6669:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 33089637-5953-4edf-8e89-39ecfabcd268@192.168.201.54@tcp t0 exp 0000000000000000 cur 84 last 0 00010000:00080000:2.0:1787758933.868308:0:7144:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 33089637-5953-4edf-8e89-39ecfabcd268@192.168.201.54@tcp t0 exp 0000000000000000 cur 84 last 0 00000100:00100000:0.0:1787758933.868309:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 119 00000100:00100000:0.0:1787758933.868323:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+10:2359:x1874601062697600:12345-192.168.201.54@tcp:400: 00000100:00100000:1.0:1787758933.868342:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062697856 00000020:00000080:2.0:1787758933.868344:0:7144:0:(genops.c:1385:class_connect()) connect: client 33089637-5953-4edf-8e89-39ecfabcd268, cookie 0xa3b7f37aab2d25a 00000020:00000080:3.0:1787758933.868344:0:6669:0:(genops.c:1385:class_connect()) connect: client 33089637-5953-4edf-8e89-39ecfabcd268, cookie 0xa3b7f37aab2d253 00000100:00100000:1.0:1787758933.868349:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062697856 00002000:00100000:2.0:1787758933.868359:0:7144:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 33089637-5953-4edf-8e89-39ecfabcd268/ffff99ccfd10d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1787758933.868367:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+10:2359:x1874601062697600:12345-192.168.201.54@tcp:400: Request processed in 45us (159us total) trans 0 rc 0/0 00002000:00100000:3.0:1787758933.868367:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 33089637-5953-4edf-8e89-39ecfabcd268/ffff99cbc557d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787758933.868381:0:7144:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787758933.868382:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 119 00000100:00100000:1.0:1787758933.868388:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 0 00002000:00100000:3.0:1787758933.868392:0:6669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787758933.868400:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfaf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33089637-5953-4edf-8e89-39ecfabcd268+6:5574:x1874601062697856:12345-192.168.201.54@tcp:33: 00002000:00080000:2.0:1787758933.868905:0:7144:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787758933.868942:0:7144:0:(import.c:65:import_set_state_nolock()) ffff99ccfd10b800 : changing import state from RECOVER to FULL 00002000:00080000:3.0:1787758933.868972:0:6669:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1787758933.868977:0:7144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33089637-5953-4edf-8e89-39ecfabcd268+6:2355:x1874601062697728:12345-192.168.201.54@tcp:8: Request processed in 703us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758933.868984:0:7144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00080000:3.0:1787758933.868996:0:6669:0:(import.c:65:import_set_state_nolock()) ffff99cbc557e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787758933.869030:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33089637-5953-4edf-8e89-39ecfabcd268+6:2355:x1874601062697472:12345-192.168.201.54@tcp:8: Request processed in 769us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758933.869038:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 8 00000004:00080000:1.0:1787758933.876824:0:5824:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8360us 00000004:00200000:1.0:1787758933.883217:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787758933.883428:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfaf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33089637-5953-4edf-8e89-39ecfabcd268+6:5574:x1874601062697856:12345-192.168.201.54@tcp:33: Request processed in 15023us (15174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758933.883441:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:0.0:1787758933.940526:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758933.940580:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062697984 00000100:00100000:3.0:1787758933.940592:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062697984 00000100:00100000:3.0:1787758933.940684:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:3.0:1787758933.940698:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1364f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+6:5612:x1874601062697984:12345-192.168.201.54@tcp:101: 00010000:00010000:3.0:1787758933.940723:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758933.940764:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cd02046c00/0xa3b7f37aab2d261 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea874d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758933.940877:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8a00/0xa3b7f37aab2d268 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758933.940895:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8a00/0xa3b7f37aab2d268 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758933.940911:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8a00/0xa3b7f37aab2d268 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787758933.941098:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787758933.941102:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787758933.941152:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8a00/0xa3b7f37aab2d268 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758933.941175:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cd02046c00/0xa3b7f37aab2d261 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea874d expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758933.941189:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8a00/0xa3b7f37aab2d268 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea874d expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758933.941196:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc7a86800) 00010000:00010000:3.0:1787758933.941199:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787758933.941201:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf72b8a00, rc 0) 00000100:00100000:3.0:1787758933.941259:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1364f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+7:5612:x1874601062697984:12345-192.168.201.54@tcp:101: Request processed in 566us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758933.941264:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 8 00010000:00010000:0.0:1787758934.044820:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758935.068761:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758935.197075:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5882d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069006720:0@lo:13: 00000100:00100000:1.0:1787758935.197171:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758935.197229:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069006720 00000100:00100000:3.0:1787758935.197239:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069006720 00000100:00080000:1.0:1787758935.197285:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787758935.197313:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787758935.197344:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069006720:12345-0@lo:13: 00002000:00000024:3.0:1787758935.197372:0:6672:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787758935.197437:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069006720:12345-0@lo:13: Request processed in 96us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758935.197446:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787758935.197504:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf5882d00 x1874601069006720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758935.197526:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5882d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069006720:0@lo:13: 00000100:00100000:2.0:1787758935.296347:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758935.296450:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062698112 00000100:00100000:1.0:1787758935.296482:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062698112 00000100:00080000:0.0:1787758935.296567:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787758935.296586:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:1.0:1787758935.296603:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6969e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+7:5665:x1874601062698112:12345-192.168.201.54@tcp:41: 00000004:00000024:1.0:1787758935.296690:0:5821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787758935.296770:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6969e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+7:5665:x1874601062698112:12345-192.168.201.54@tcp:41: Request processed in 174us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758935.296778:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:1.0:1787758935.298165:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758935.298219:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062698240 00000100:00100000:2.0:1787758935.298225:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062698240 00000100:00080000:0.0:1787758935.298269:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787758935.298277:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:2.0:1787758935.298289:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfafc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:33089637-5953-4edf-8e89-39ecfabcd268+6:5665:x1874601062698240:12345-192.168.201.54@tcp:13: 00002000:00000024:2.0:1787758935.298307:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787758935.298364:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfafc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:33089637-5953-4edf-8e89-39ecfabcd268+6:5665:x1874601062698240:12345-192.168.201.54@tcp:13: Request processed in 78us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758935.298372:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:0.0:1787758935.299042:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758935.299080:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062698368 00000100:00100000:3.0:1787758935.299089:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062698368 00000100:00100000:3.0:1787758935.299137:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00080000:0.0:1787758935.299149:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787758935.299150:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce13670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:33089637-5953-4edf-8e89-39ecfabcd268+6:5665:x1874601062698368:12345-192.168.201.54@tcp:13: 00002000:00000024:3.0:1787758935.299172:0:6672:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787758935.299219:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce13670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:33089637-5953-4edf-8e89-39ecfabcd268+6:5665:x1874601062698368:12345-192.168.201.54@tcp:13: Request processed in 75us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758935.299223:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 5 00000001:02000400:2.0:1787758936.090523:0:8272:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787758936.093023:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758936.732789:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787758936.732813:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1389e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069006848:0@lo:13: 00000100:00100000:1.0:1787758936.732814:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc6969a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874601069007104:0@lo:400: 00000100:00100000:3.0:1787758936.732816:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc6969680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601069006976:0@lo:400: 00000100:00100000:3.0:1787758936.732908:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758936.732909:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758936.732909:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758936.732976:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1874601069007232:0@lo:400: 00000100:00100000:3.0:1787758936.732982:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1874601069007488:0@lo:400: 00000100:00100000:1.0:1787758936.732983:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069007616:0@lo:400: 00000100:00100000:0.0:1787758936.733016:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758936.733035:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758936.733035:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069006976 00000100:00100000:3.0:1787758936.733043:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069006976 00000100:00100000:0.0:1787758936.733047:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787758936.733056:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069007360:0@lo:400: 00000100:00100000:1.0:1787758936.733078:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069007616 00000100:00100000:1.0:1787758936.733083:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069007616 00000100:00100000:0.0:1787758936.733095:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758936.733111:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787758936.733126:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3292:x1874601069006976:12345-0@lo:400: 00000100:00100000:0.0:1787758936.733137:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069007104 00000100:00100000:1.0:1787758936.733137:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069007360 00000100:00100000:0.0:1787758936.733141:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069007104 00000100:00100000:1.0:1787758936.733143:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069007360 00000100:00100000:0.0:1787758936.733177:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069007232 00000100:00100000:0.0:1787758936.733182:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069007232 00000100:00100000:1.0:1787758936.733184:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787758936.733189:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3292:x1874601069006976:12345-0@lo:400: Request processed in 64us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758936.733198:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069007616:12345-0@lo:400: 00000100:00100000:3.0:1787758936.733204:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1787758936.733223:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787758936.733243:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787758936.733252:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce10903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069007360:12345-0@lo:400: 00000100:00100000:3.0:1787758936.733257:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787758936.733259:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069007616:12345-0@lo:400: Request processed in 61us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758936.733262:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069006848 00000100:00100000:2.0:1787758936.733269:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069006848 00000100:00100000:1.0:1787758936.733270:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787758936.733272:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874601069007104:12345-0@lo:400: 00000100:00100000:0.0:1787758936.733296:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce10903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069007360:12345-0@lo:400: Request processed in 45us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758936.733303:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787758936.733315:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787758936.733317:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf56d8b40 x1874601069007616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758936.733328:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874601069007104:12345-0@lo:400: Request processed in 59us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758936.733329:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce10912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069006848:12345-0@lo:13: 00000100:00100000:1.0:1787758936.733332:0:3293:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787758936.733344:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787758936.733351:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787758936.733356:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069007616:0@lo:400: 00000100:00100000:0.0:1787758936.733361:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1092580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1874601069007232:12345-0@lo:400: 00002000:00000024:2.0:1787758936.733368:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787758936.733376:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc6969a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874601069007104:0@lo:400: 00000100:00100000:0.0:1787758936.733394:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1092580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1874601069007232:12345-0@lo:400: Request processed in 37us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758936.733400:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787758936.733415:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787758936.733420:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce10912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069006848:12345-0@lo:13: Request processed in 96us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758936.733443:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787758936.733461:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf56d8780 x1874601069007360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758936.733473:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069007360:0@lo:400: 00000100:00100000:0.0:1787758936.733493:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1874601069007232:0@lo:400: 00010000:00080000:0.0:1787758936.733511:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cce1389e00 x1874601069006848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758936.733528:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1389e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069006848:0@lo:13: 00000100:00100000:2.0:1787758936.733529:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758936.733562:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069007488 00000100:00100000:0.0:1787758936.733566:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069007488 00000100:00100000:2.0:1787758936.733578:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc6969680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601069006976:0@lo:400: 00000100:00100000:0.0:1787758936.733604:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787758936.733612:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874601069007488:12345-0@lo:400: 00000100:00080000:3.0:1787758936.733660:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787758936.733670:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874601069007488:12345-0@lo:400: Request processed in 58us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758936.733679:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787758936.733691:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1874601069007488:0@lo:400: 00000001:00100000:1.0:1787758936.740418:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 33089637-5953-4edf-8e89-39ecfabcd268 00010000:00010000:1.0:1787758937.116733:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787758937.160990:0:8420:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa0cf7ac0 20000000:00000080:1.0:1787758937.161012:0:8420:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ccf5a86000 uarg=0000000000000000 20000000:01000000:1.0:1787758937.161056:0:8420:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787758937.161059:0:8420:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787758937.161063:0:8420:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787758937.161069:0:8420:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787758937.161081:0:8420:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787758937.161099:0:8420:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787758937.161102:0:8420:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787758937.161325:0:8420:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787758937.161328:0:8420:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787758937.161839:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1787758937.162188:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1787758937.162227:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1787758937.162245:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1787758937.162253:0:8420:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787758937.162255:0:8420:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787758937.162831:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787758937.163035:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787758937.163093:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787758937.163126:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1787758937.163138:0:8420:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787758937.163140:0:8420:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787758937.163717:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787758937.163881:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787758937.163913:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1787758937.163932:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1787758937.163939:0:8420:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787758937.163944:0:8420:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787758937.164413:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787758937.164596:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787758937.164654:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787758937.164698:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:2.0:1787758937.164709:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787758937.164729:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cccf889e00/0xa3b7f37aab2d26f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.164745:0:8420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccd96fd000/0xa3b7f37aab2d16c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d165 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.164751:0:8420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d18f expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.164756:0:8420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cccf888c00/0xa3b7f37aab2d1c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d1b9 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.164760:0:8420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cd02046a00/0xa3b7f37aab2d1ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d1c7 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.164763:0:8420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccd96fd400/0xa3b7f37aab2d1dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d1d5 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.164767:0:8420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d1f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d1f1 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.164771:0:8420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccd96fce00/0xa3b7f37aab2d222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d21b expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.164778:0:8420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cd02046200/0xa3b7f37aab2d230 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86eb expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.164790:0:8420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cd02046000/0xa3b7f37aab2d237 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86f2 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.164795:0:8420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cccf889e00/0xa3b7f37aab2d26f lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.164833:0:8420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cd02046000/0xa3b7f37aab2d237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86f2 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.164844:0:8420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cd02046000/0xa3b7f37aab2d237 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86f2 expref: 9 pid: 5815 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.164856:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069007744:192.168.201.54@tcp:104: 00010000:00010000:2.0:1787758937.164954:0:8420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cd02046200/0xa3b7f37aab2d230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86eb expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.164960:0:8420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cd02046200/0xa3b7f37aab2d230 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86eb expref: 9 pid: 5815 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.164966:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069007872:192.168.201.54@tcp:104: 00010000:00010000:2.0:1787758937.164988:0:8420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccd96fce00/0xa3b7f37aab2d222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d21b expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.164995:0:8420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ccd96fce00/0xa3b7f37aab2d222 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d21b expref: 18 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.165006:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069008000:0@lo:104: 00000100:00100000:2.0:1787758937.165048:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787758937.165095:0:8420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d1f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d1f1 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758937.165097:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069008000 00010000:00010000:2.0:1787758937.165105:0:8420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d1f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d1f1 expref: 18 pid: 5815 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758937.165105:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069008000 00000100:00100000:2.0:1787758937.165115:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56db0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069008128:0@lo:104: 00000100:00100000:2.0:1787758937.165133:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787758937.165153:0:8420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccd96fd400/0xa3b7f37aab2d1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d1d5 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.165159:0:8420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ccd96fd400/0xa3b7f37aab2d1dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d1d5 expref: 18 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.165165:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56db840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069008256:0@lo:104: 00000100:00100000:1.0:1787758937.165166:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069008128 00000100:00100000:1.0:1787758937.165172:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069008128 00000100:00100000:2.0:1787758937.165187:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758937.165204:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069008256 00000100:00100000:1.0:1787758937.165208:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069008256 00000100:00100000:3.0:1787758937.165210:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1787758937.165211:0:8420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cd02046a00/0xa3b7f37aab2d1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d1c7 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.165224:0:8420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cd02046a00/0xa3b7f37aab2d1ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d1c7 expref: 18 pid: 5815 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758937.165229:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787758937.165232:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069008384:0@lo:104: 00000100:00100000:3.0:1787758937.165237:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787758937.165244:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:8420:x1874601069008000:12345-0@lo:104: 00000100:00100000:3.0:1787758937.165248:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:8420:x1874601069008128:12345-0@lo:104: 00000100:00100000:2.0:1787758937.165258:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787758937.165261:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99ccc0030e00/0xa3b7f37aab2d1f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d1f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.165266:0:6684:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d21b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d222 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.165278:0:5805:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00010000:00010000:2.0:1787758937.165285:0:8420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cccf888c00/0xa3b7f37aab2d1c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d1b9 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.165289:0:5805:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:2.0:1787758937.165298:0:8420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cccf888c00/0xa3b7f37aab2d1c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d1b9 expref: 18 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.165308:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069008512:0@lo:104: 00010000:00010000:3.0:1787758937.165321:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787758937.165328:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:8420:x1874601069008128:12345-0@lo:104: Request processed in 84us (193us total) trans 0 rc 0/0 00010000:00010000:0.0:1787758937.165331:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787758937.165335:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787758937.165341:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:8420:x1874601069008000:12345-0@lo:104: Request processed in 101us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758937.165341:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758937.165349:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787758937.165354:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069008384 00000100:00100000:3.0:1787758937.165357:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069008384 00010000:00010000:2.0:1787758937.165367:0:8420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d18f expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.165370:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069008512 00000100:00100000:0.0:1787758937.165375:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787758937.165376:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069008512 00010000:00010000:2.0:1787758937.165380:0:8420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d196 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d18f expref: 18 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758937.165383:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcf97c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:8420:x1874601069008256:12345-0@lo:104: 00010000:00010000:0.0:1787758937.165391:0:6684:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99ccc0031200/0xa3b7f37aab2d1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d1dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.165391:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56da1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069008640:0@lo:104: 00000100:00100000:1.0:1787758937.165401:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787758937.165412:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:8420:x1874601069008512:12345-0@lo:104: 00000100:00100000:2.0:1787758937.165419:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787758937.165436:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1787758937.165436:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99ccd96fc600/0xa3b7f37aab2d1b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d1c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758937.165447:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcf97c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:8420:x1874601069008256:12345-0@lo:104: Request processed in 64us (258us total) trans 0 rc 0/0 00010000:00010000:2.0:1787758937.165453:0:8420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccd96fd000/0xa3b7f37aab2d16c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d165 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758937.165456:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787758937.165462:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069008640 00010000:00010000:2.0:1787758937.165463:0:8420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ccd96fd000/0xa3b7f37aab2d16c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d165 expref: 18 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758937.165466:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069008640 00000100:00100000:2.0:1787758937.165477:0:8420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069008768:0@lo:104: 00000100:00100000:3.0:1787758937.165486:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1787758937.165493:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787758937.165494:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:8420:x1874601069008384:12345-0@lo:104: 00010000:00010000:3.0:1787758937.165503:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99ccc0031000/0xa3b7f37aab2d1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d1ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.165505:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:8420:x1874601069008512:12345-0@lo:104: Request processed in 93us (163us total) trans 0 rc 0/0 00010000:00010000:0.0:1787758937.165508:0:7614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:2.0:1787758937.165509:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787758937.165518:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99ccc0030e00/0xa3b7f37aab2d1f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d1f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.165525:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787758937.165532:0:8420:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfcf86cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787758937.165533:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0030e00 already unused, calling callback (ffffffffc1c61c20) 10000000:00010000:0.0:1787758937.165538:0:7614:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99ccc0030e00/0xa3b7f37aab2d1f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d1f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.165546:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069008768 00010000:00010000:0.0:1787758937.165548:0:7614:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99ccc0030e00/0xa3b7f37aab2d1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d1f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.165548:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787758937.165551:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069008768 00000100:00100000:3.0:1787758937.165557:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:8420:x1874601069008384:12345-0@lo:104: Request processed in 63us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758937.165559:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069008000:0@lo:104: 00000100:00100000:3.0:1787758937.165572:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787758937.165577:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56db0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069008128:0@lo:104: 10000000:00010000:0.0:1787758937.165578:0:7614:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99ccc0030e00/0xa3b7f37aab2d1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d1f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.165586:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 10000000:01000000:0.0:1787758937.165589:0:7614:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787758937.165592:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56db840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069008256:0@lo:104: 00000100:00100000:1.0:1787758937.165600:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56dad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+4:8420:x1874601069008640:12345-0@lo:104: 00000100:00100000:3.0:1787758937.165602:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787758937.165606:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069008384:0@lo:104: 00010000:00010000:1.0:1787758937.165634:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d18f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d196 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.165645:0:7614:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99ccc0030e00/0xa3b7f37aab2d1f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d1f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.165645:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069008512:0@lo:104: 00000100:00100000:3.0:1787758937.165648:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56d8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+4:8420:x1874601069008768:12345-0@lo:104: 00010000:00010000:0.0:1787758937.165661:0:7614:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787758937.165664:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99cd02046400/0xa3b7f37aab2d165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d16c expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.165683:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99ccc0030e00/0xa3b7f37aab2d1f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d1f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758937.165686:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 00010000:00010000:0.0:1787758937.165691:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99ccc0030e00/0xa3b7f37aab2d1f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d1f8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758937.165691:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 00010000:00010000:1.0:1787758937.165694:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 10000000:01000000:2.0:1787758937.165696:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00000100:00100000:1.0:1787758937.165705:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56dad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+4:8420:x1874601069008640:12345-0@lo:104: Request processed in 108us (288us total) trans 0 rc 0/0 00010000:00010000:0.0:1787758937.165708:0:7614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787758937.165710:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00010000:00010000:0.0:1787758937.165716:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d21b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d222 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.165718:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.165720:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787758937.165722:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56d8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+4:8420:x1874601069008768:12345-0@lo:104: Request processed in 107us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758937.165739:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1787758937.165745:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787758937.165748:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccd96fd800 already unused, calling callback (ffffffffc1c61c20) 00010000:00010000:2.0:1787758937.165749:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758937.165755:0:7614:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d21b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d222 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.165755:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99ccc0031200/0xa3b7f37aab2d1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d1dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.165758:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.165772:0:7614:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d21b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d222 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.165773:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787758937.165777:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031200 already unused, calling callback (ffffffffc1c61c20) 00010000:00010000:3.0:1787758937.165781:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99ccd96fc600/0xa3b7f37aab2d1b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d1c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.165783:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069009024:0@lo:101: 10000000:00010000:1.0:1787758937.165784:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99ccc0031200/0xa3b7f37aab2d1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d1dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758937.165788:0:7614:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d21b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d222 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.165803:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccd96fc600 already unused, calling callback (ffffffffc1c61c20) 00010000:00010000:1.0:1787758937.165809:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99ccc0031200/0xa3b7f37aab2d1d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d1dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758937.165810:0:7614:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:3.0:1787758937.165811:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99ccd96fc600/0xa3b7f37aab2d1b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d1c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.165823:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1787758937.165831:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99ccc0031200/0xa3b7f37aab2d1d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d1dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.165833:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99ccd96fc600/0xa3b7f37aab2d1b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d1c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.165834:0:7614:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d21b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d222 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.165846:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfcf86f00 going to sleep for 11 seconds 10000000:01000000:1.0:1787758937.165852:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787758937.165856:0:7614:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1787758937.165856:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99ccd96fc600/0xa3b7f37aab2d1b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d1c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787758937.165865:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787758937.165867:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d21b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d222 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.165870:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56da1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069008640:0@lo:104: 00010000:00010000:0.0:1787758937.165875:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99ccd96fd800/0xa3b7f37aab2d21b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d222 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.165878:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069008768:0@lo:104: 00010000:00010000:0.0:1787758937.165887:0:7614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787758937.165890:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99ccc0031000/0xa3b7f37aab2d1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d1ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.165894:0:6685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787758937.165941:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc0031000 already unused, calling callback (ffffffffc1c61c20) 00010000:00010000:1.0:1787758937.165942:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99ccc0031200/0xa3b7f37aab2d1d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d1dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758937.165947:0:7614:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99ccc0031000/0xa3b7f37aab2d1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d1ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.165952:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99ccd96fc600/0xa3b7f37aab2d1b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d1c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.165954:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787758937.165969:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787758937.165970:0:7614:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99ccc0031000/0xa3b7f37aab2d1c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d1ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.165979:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99ccc0031200/0xa3b7f37aab2d1d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d1dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758937.165980:0:7614:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99ccc0031000/0xa3b7f37aab2d1c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d1ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.165982:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99ccd96fc600/0xa3b7f37aab2d1b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d1c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.166000:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99ccc0031200/0xa3b7f37aab2d1d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d1dc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.166006:0:8426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:0.0:1787758937.166009:0:7614:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787758937.166015:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d18f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d196 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.166026:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99ccd96fc600/0xa3b7f37aab2d1b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d1c0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.166028:0:7614:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99ccc0031000/0xa3b7f37aab2d1c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d1ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.166035:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd02047800 already unused, calling callback (ffffffffc1c61c20) 10000000:00010000:2.0:1787758937.166040:0:6685:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d18f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d196 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.166053:0:6685:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d18f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d196 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.166054:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758937.166056:0:7614:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787758937.166058:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758937.166059:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758937.166062:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99ccc0031000/0xa3b7f37aab2d1c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d1ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787758937.166064:0:6685:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d18f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d196 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.166064:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758937.166065:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758937.166070:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787758937.166075:0:6685:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787758937.166083:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601069009280:0@lo:103: 00010000:00010000:0.0:1787758937.166084:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99ccc0031000/0xa3b7f37aab2d1c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d1ce expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.166089:0:6685:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d18f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d196 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.166098:0:6685:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787758937.166101:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758937.166103:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758937.166103:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d18f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d196 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.166106:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758937.166110:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99cd02047800/0xa3b7f37aab2d18f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d196 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758937.166119:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1091a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601069008896:0@lo:103: 00010000:00010000:2.0:1787758937.166121:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758937.166123:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758937.166125:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758937.166129:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758937.166155:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758937.166162:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787758937.166171:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf58803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601069009408:0@lo:103: 00000100:00100000:0.0:1787758937.166184:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1091e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601069009536:0@lo:103: 00000100:00100000:1.0:1787758937.166206:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758937.166221:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069007872:192.168.201.54@tcp:104: 00000100:00100000:0.0:1787758937.166225:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069009280 00000100:00100000:0.0:1787758937.166229:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069009280 00010000:00010000:0.0:1787758937.166250:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccd96fd400/0xa3b7f37aab2d1dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d1d5 expref: 19 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.166255:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069008896 00000100:00100000:1.0:1787758937.166261:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069008896 00000100:00100000:2.0:1787758937.166264:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1090f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3291:1874601069009152:0@lo:103: 00000100:00100000:0.0:1787758937.166272:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069009408 00000100:00100000:0.0:1787758937.166276:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069009408 00010000:00010000:1.0:1787758937.166281:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d1f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d1f1 expref: 21 pid: 5815 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.166292:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cccf888c00/0xa3b7f37aab2d1c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d1b9 expref: 21 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.166298:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758937.166310:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069009152 00000100:00100000:1.0:1787758937.166315:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069009152 00000100:00100000:0.0:1787758937.166316:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787758937.166326:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc9720450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+22:3292:x1874601069009280:12345-0@lo:103: 00010000:00010000:1.0:1787758937.166332:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccd96fce00/0xa3b7f37aab2d222 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d21b expref: 22 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.166337:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787758937.166346:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccd96fd400/0xa3b7f37aab2d1dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d1d5 expref: 22 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.166348:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3291:1874601069009664:0@lo:103: 00000100:00100000:1.0:1787758937.166356:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787758937.166359:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccd96fd400/0xa3b7f37aab2d1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d1d5 expref: 22 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758937.166362:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758937.166372:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1092d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+22:3290:x1874601069008896:12345-0@lo:103: 00000100:00100000:2.0:1787758937.166382:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069009024 00000100:00100000:2.0:1787758937.166386:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069009024 00010000:00010000:1.0:1787758937.166387:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787758937.166397:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccd96fd400/0xa3b7f37aab2d1dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d1d5 expref: 23 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.166398:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d1f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d1f1 expref: 23 pid: 5815 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758937.166398:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758937.166418:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00010000:00010000:1.0:1787758937.166433:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d1f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d1f1 expref: 22 pid: 5815 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.166441:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+22:5818:x1874601069009024:12345-0@lo:101: 00010000:00010000:0.0:1787758937.166444:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787758937.166451:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd02047400/0xa3b7f37aab2d1f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d1f1 expref: 22 pid: 5815 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.166457:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758937.166470:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cccf888400/0xa3b7f37aab2d27d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d276 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.166472:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787758937.166484:0:8420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8420:1874601069007744:192.168.201.54@tcp:104: 00000100:00100000:0.0:1787758937.166485:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc9720450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+22:3292:x1874601069009280:12345-0@lo:103: Request processed in 160us (357us total) trans 0 rc 0/0 00010000:00010000:2.0:1787758937.166489:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cccf889e00/0xa3b7f37aab2d26f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758937.166497:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787758937.166498:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cccf888400/0xa3b7f37aab2d27d lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d276 expref: 22 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.166510:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1092d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+21:3290:x1874601069008896:12345-0@lo:103: Request processed in 141us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758937.166523:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787758937.166527:0:5815:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff99cccf889e00/0xa3b7f37aab2d26f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.166537:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062698496 00000100:00100000:1.0:1787758937.166541:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062698496 00010000:00010000:2.0:1787758937.166544:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cccf888400/0xa3b7f37aab2d27d lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d276 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.166553:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cccf888400, rc 0) 00000100:00100000:0.0:1787758937.166558:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069009664 00010000:00010000:1.0:1787758937.166559:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cd02046200/0xa3b7f37aab2d230 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86eb expref: 10 pid: 5815 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758937.166564:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069009664 00010000:00010000:0.0:1787758937.166582:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d196 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d18f expref: 21 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.166586:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787758937.166594:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+21:5818:x1874601069009024:12345-0@lo:101: Request processed in 155us (774us total) trans 0 rc 0/0 00010000:00010000:3.0:1787758937.166599:0:8420:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cccf889e00/0xa3b7f37aab2d26f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.166600:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfae580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+21:3292:x1874601069009408:12345-0@lo:103: 00000100:00100000:0.0:1787758937.166607:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787758937.166607:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787758937.166645:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+21:3291:x1874601069009152:12345-0@lo:103: 00010000:00010000:0.0:1787758937.166653:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787758937.166658:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccd96fce00/0xa3b7f37aab2d222 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d21b expref: 20 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.166667:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccd96fce00/0xa3b7f37aab2d222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d21b expref: 20 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.166674:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069009024:0@lo:101: 00010000:00010000:3.0:1787758937.166675:0:8427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758937.166679:0:8427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758937.166680:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccd96fce00/0xa3b7f37aab2d222 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d21b expref: 20 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.166684:0:8427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758937.166688:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d276 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d27d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.166692:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787758937.166693:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99cd02046400/0xa3b7f37aab2d165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d16c expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.166696:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d276 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d27d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.166705:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd02046400 already unused, calling callback (ffffffffc1c61c20) 10000000:00010000:3.0:1787758937.166711:0:8426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99cd02046400/0xa3b7f37aab2d165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d16c expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.166719:0:8426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99cd02046400/0xa3b7f37aab2d165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d16c expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758937.166725:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3291:x1874601069009152:12345-0@lo:103: Request processed in 81us (426us total) trans 0 rc 0/0 10000000:00010000:3.0:1787758937.166731:0:8426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99cd02046400/0xa3b7f37aab2d165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d16c expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758937.166737:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 10000000:01000000:3.0:1787758937.166743:0:8426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787758937.166745:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:0.0:1787758937.166755:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787758937.166755:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5880b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5453e3da-9a83-4395-adba-03dea8a5243b+10:2356:x1874601062698496:12345-192.168.201.54@tcp:103: 00010000:00010000:2.0:1787758937.166764:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787758937.166772:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5882940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:3291:x1874601069009664:12345-0@lo:103: 00010000:00010000:2.0:1787758937.166772:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cd02046200/0xa3b7f37aab2d230 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86eb expref: 10 pid: 5815 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.166772:0:8426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99cd02046400/0xa3b7f37aab2d165 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d16c expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.166783:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787758937.166791:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d196 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d18f expref: 18 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.166792:0:8426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787758937.166793:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cd02046200/0xa3b7f37aab2d230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86eb expref: 10 pid: 5815 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.166803:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d18f expref: 18 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.166807:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99cd02046400/0xa3b7f37aab2d165 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d16c expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.166814:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99cd02046400/0xa3b7f37aab2d165 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d16c expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.166819:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd02046200/0xa3b7f37aab2d230 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86eb expref: 10 pid: 5815 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.166821:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cccf889800/0xa3b7f37aab2d196 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d18f expref: 18 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.166826:0:8426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758937.166831:0:8426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758937.166834:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787758937.166835:0:8426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758937.166837:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787758937.166867:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1090f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3291:1874601069009152:0@lo:103: 00000100:00100000:0.0:1787758937.166869:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5882940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:3291:x1874601069009664:12345-0@lo:103: Request processed in 102us (472us total) trans 0 rc 0/0 00010000:00010000:1.0:1787758937.166869:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787758937.166869:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5880b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5453e3da-9a83-4395-adba-03dea8a5243b+9:2356:x1874601062698496:12345-192.168.201.54@tcp:103: Request processed in 114us (511us total) trans 0 rc 0/0 00010000:00010000:1.0:1787758937.166879:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cccf888c00/0xa3b7f37aab2d1c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d1b9 expref: 17 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758937.166883:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787758937.166885:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3291:1874601069009664:0@lo:103: 00000100:00100000:2.0:1787758937.166893:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 15 00010000:00010000:1.0:1787758937.166903:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cccf888c00/0xa3b7f37aab2d1c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d1b9 expref: 16 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758937.166913:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787758937.166922:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cccf888c00/0xa3b7f37aab2d1c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d1b9 expref: 16 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.166936:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787758937.166939:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf58812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601069009792:0@lo:103: 00000100:00100000:0.0:1787758937.166957:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1091a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601069008896:0@lo:103: 00000100:00100000:2.0:1787758937.166963:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758937.166983:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069009536 00000100:00100000:3.0:1787758937.166984:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758937.166985:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfae580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:3292:x1874601069009408:12345-0@lo:103: Request processed in 386us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758937.166990:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069009536 00000100:00100000:1.0:1787758937.166997:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1787758937.167006:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cd02046a00/0xa3b7f37aab2d1ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d1c7 expref: 16 pid: 5815 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.167012:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062698624 00000100:00100000:1.0:1787758937.167017:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062698624 00000100:00100000:0.0:1787758937.167022:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069009792 00000100:00100000:0.0:1787758937.167026:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069009792 00010000:00010000:1.0:1787758937.167033:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cd02046000/0xa3b7f37aab2d237 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86f2 expref: 9 pid: 5815 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.167040:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccd96fd000/0xa3b7f37aab2d16c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d165 expref: 16 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.167072:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787758937.167079:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 18 00000100:00100000:1.0:1787758937.167084:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1093c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:3290:x1874601069009536:12345-0@lo:103: 00000100:00100000:0.0:1787758937.167091:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc9723450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5453e3da-9a83-4395-adba-03dea8a5243b+9:2357:x1874601062698624:12345-192.168.201.54@tcp:103: 00000100:00100000:3.0:1787758937.167099:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf58803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601069009408:0@lo:103: 00000100:00100000:2.0:1787758937.167102:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1787758937.167103:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787758937.167113:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cd02046a00/0xa3b7f37aab2d1ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d1c7 expref: 16 pid: 5815 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.167115:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787758937.167117:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601069009280:0@lo:103: 00000100:00100000:2.0:1787758937.167119:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:3292:x1874601069009792:12345-0@lo:103: 00010000:00010000:0.0:1787758937.167126:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cd02046000/0xa3b7f37aab2d237 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86f2 expref: 9 pid: 5815 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.167132:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787758937.167137:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cd02046a00/0xa3b7f37aab2d1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d1c7 expref: 16 pid: 5815 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.167139:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccd96fd000/0xa3b7f37aab2d16c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d165 expref: 16 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.167161:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cd02046000/0xa3b7f37aab2d237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86f2 expref: 9 pid: 5815 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.167174:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd02046a00/0xa3b7f37aab2d1ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d1c7 expref: 16 pid: 5815 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.167175:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccd96fd000/0xa3b7f37aab2d16c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d165 expref: 16 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.167199:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd02046000/0xa3b7f37aab2d237 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea86f2 expref: 9 pid: 5815 timeout: 187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.167202:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccd96fd000/0xa3b7f37aab2d16c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d165 expref: 15 pid: 5816 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.167204:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cccf889e00/0xa3b7f37aab2d26f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.167221:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cccf889e00/0xa3b7f37aab2d26f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.167230:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787758937.167230:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787758937.167235:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cccf889e00/0xa3b7f37aab2d26f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.167243:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cccf889e00/0xa3b7f37aab2d26f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.167251:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cccf889e00/0xa3b7f37aab2d26f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.167259:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cccf889e00/0xa3b7f37aab2d26f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758937.167261:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc9723450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5453e3da-9a83-4395-adba-03dea8a5243b+8:2357:x1874601062698624:12345-192.168.201.54@tcp:103: Request processed in 173us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758937.167264:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:3292:x1874601069009792:12345-0@lo:103: Request processed in 150us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758937.167275:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 18 00000100:00100000:2.0:1787758937.167278:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1787758937.167289:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cccf889e00 already unused, calling callback (ffffffffc1666530) 00010000:00010000:1.0:1787758937.167294:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cccf889e00/0xa3b7f37aab2d26f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.167303:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cccf889e00/0xa3b7f37aab2d26f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.167305:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf58812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601069009792:0@lo:103: 00010000:00010000:1.0:1787758937.167325:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cccf888400/0xa3b7f37aab2d27d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xa3b7f37aab2d276 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.167334:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cccf888400/0xa3b7f37aab2d27d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xa3b7f37aab2d276 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.167344:0:8420:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cccf889e00/0xa3b7f37aab2d26f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.167356:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff99cccf888400/0xa3b7f37aab2d27d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d276 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.167367:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:5806:1874601069009920:0@lo:105: 00010000:00010000:3.0:1787758937.167381:0:8420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cccf889e00/0xa3b7f37aab2d26f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.167394:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758937.167419:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd26d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787758937.167445:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069009920 00000100:00100000:0.0:1787758937.167451:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069009920 00000100:00100000:0.0:1787758937.167483:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787758937.167493:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+3:5806:x1874601069009920:12345-0@lo:105: 00010000:00010000:0.0:1787758937.167501:0:5805:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d276 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d27d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.167511:0:5805:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d276 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d27d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.167520:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d276 lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xa3b7f37aab2d27d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.167528:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d276 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xa3b7f37aab2d27d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.167548:0:5805:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d276 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0xa3b7f37aab2d27d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758937.167566:0:5805:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff99cccf889c00) 00010000:00010000:2.0:1787758937.167571:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d27d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758937.167579:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d27d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758937.167607:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+3:5806:x1874601069009920:12345-0@lo:105: Request processed in 115us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758937.167638:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787758937.167647:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069010048:0@lo:501: 00000100:00100000:1.0:1787758937.167660:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:5806:1874601069009920:0@lo:105: 00000100:00100000:2.0:1787758937.167675:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787758937.167678:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cccf889e00/0xa3b7f37aab2d26f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.167688:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cccf889e00/0xa3b7f37aab2d26f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758937.167702:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfcf86f00 going to sleep for 11 seconds 00010000:00010000:1.0:1787758937.167704:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787758937.167706:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069010048 00000100:00100000:0.0:1787758937.167723:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069010048 00000100:00100000:1.0:1787758937.167746:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1093c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:3290:x1874601069009536:12345-0@lo:103: Request processed in 665us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758937.167754:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1091e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601069009536:0@lo:103: 00000100:00100000:0.0:1787758937.167759:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787758937.167771:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787758937.167775:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:5818:x1874601069010048:12345-0@lo:501: 00000100:00100000:0.0:1787758937.167989:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:5818:x1874601069010048:12345-0@lo:501: Request processed in 219us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758937.167994:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069010048:0@lo:501: 00000100:00100000:0.0:1787758937.168004:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787758937.168022:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069010176:0@lo:503: 00000100:00100000:2.0:1787758937.168058:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758937.168079:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfcf86f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787758937.168098:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069010176 00000100:00100000:0.0:1787758937.168103:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069010176 00000100:00100000:0.0:1787758937.168130:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787758937.168139:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:5818:x1874601069010176:12345-0@lo:503: 00000100:00100000:0.0:1787758937.168269:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:5818:x1874601069010176:12345-0@lo:503: Request processed in 130us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758937.168271:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069010176:0@lo:503: 00000100:00100000:0.0:1787758937.168285:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787758937.168463:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8428:1874601069010304:0@lo:502: 00000100:00100000:2.0:1787758937.168490:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758937.168508:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfcf86180 going to sleep for 11 seconds 00000100:00100000:0.0:1787758937.168527:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069010304 00000100:00100000:0.0:1787758937.168533:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069010304 00000100:00100000:0.0:1787758937.168561:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787758937.168570:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:8428:x1874601069010304:12345-0@lo:502: 00000100:00100000:0.0:1787758937.168775:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:8428:x1874601069010304:12345-0@lo:502: Request processed in 206us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758937.168785:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8428:1874601069010304:0@lo:502: 00000100:00100000:0.0:1787758937.168790:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000020:01000000:2.0:1787758937.168808:0:8428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787758937.168816:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758937.168818:0:8428:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787758937.168824:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787758937.168841:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8428:1874601069010432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787758937.168867:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758937.168891:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfcf86180 going to sleep for 11 seconds 00000100:00100000:0.0:1787758937.168904:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069010432 00000100:00100000:0.0:1787758937.168909:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069010432 00000100:00100000:0.0:1787758937.168935:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787758937.168942:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:8428:x1874601069010432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758937.169084:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:8428:x1874601069010432:12345-0@lo:502:llog_process_th.0 Request processed in 141us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758937.169092:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787758937.169097:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8428:1874601069010432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787758937.169121:0:8428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787758937.169125:0:8428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787758937.169130:0:8428:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787758937.169134:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787758937.169202:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787758937.169226:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787758937.169233:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d276 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d27d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.169242:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99cccf889c00/0xa3b7f37aab2d276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d27d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758937.169251:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787758937.169253:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99ccc74c3490 from 1 10000000:01000000:1.0:1787758937.169256:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787758937.169271:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a800/0xa3b7f37aab2d284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.169278:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a800/0xa3b7f37aab2d284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.169287:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a800/0xa3b7f37aab2d284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758937.169300:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069010560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787758937.169331:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758937.169355:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd26d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787758937.169664:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069010560 00000100:00100000:1.0:1787758937.169669:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069010560 00000100:00100000:1.0:1787758937.169698:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787758937.169706:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+13:5818:x1874601069010560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787758937.169713:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758937.169727:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccfd17b400/0xa3b7f37aab2d28b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d284 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.169742:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccfd17b400/0xa3b7f37aab2d28b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d284 expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.169751:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccfd17b400/0xa3b7f37aab2d28b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d284 expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.169758:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccfd17b400, rc 0) 00000100:00100000:1.0:1787758937.169788:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:5818:x1874601069010560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758937.169795:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787758937.169820:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069010560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787758937.169829:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a800/0xa3b7f37aab2d284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d28b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758937.169838:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a800/0xa3b7f37aab2d284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d28b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758937.169878:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf58803c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069010688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787758937.169956:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758937.169981:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc95dc240 going to sleep for 11 seconds 00000100:00100000:0.0:1787758937.169992:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069010688 00000100:00100000:0.0:1787758937.169997:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069010688 00000100:00100000:0.0:1787758937.170026:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787758937.170032:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:5818:x1874601069010688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787758937.170166:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:5818:x1874601069010688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (209us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787758937.170174:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787758937.170193:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf58803c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069010688:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787758937.170215:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787758937.170220:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a800/0xa3b7f37aab2d284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d28b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758937.170228:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a800/0xa3b7f37aab2d284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d28b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758938.140791:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787758938.283875:0:5843:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 33089637-5953-4edf-8e89-39ecfabcd268 00000001:00100000:3.0:1787758938.283909:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 33089637-5953-4edf-8e89-39ecfabcd268 10000000:01000000:3.0:1787758938.396702:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787758938.396709:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ccffe2e000 from 39 10000000:01000000:3.0:1787758938.396720:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787758938.396759:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccf72b9c00/0xa3b7f37aab2d292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758938.396768:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99ccf72b9c00/0xa3b7f37aab2d292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758938.396776:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99ccf72b9c00/0xa3b7f37aab2d292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758938.396795:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069010816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787758938.396851:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758938.396900:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069010816 00000100:00100000:3.0:1787758938.396907:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc95dcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787758938.396908:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069010816 00000100:00100000:1.0:1787758938.396966:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787758938.396981:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+14:5818:x1874601069010816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787758938.396995:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758938.397020:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccfd17ba00/0xa3b7f37aab2d299 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d292 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758938.397044:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccfd17ba00/0xa3b7f37aab2d299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d292 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758938.397070:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccfd17ba00/0xa3b7f37aab2d299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d292 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758938.397080:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccfd17ba00, rc 0) 00000100:00100000:1.0:1787758938.397125:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601069010816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758938.397145:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787758938.397176:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069010816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787758938.397192:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99ccf72b9c00/0xa3b7f37aab2d292 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d299 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758938.397202:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99ccf72b9c00/0xa3b7f37aab2d292 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d299 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758938.397260:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069010944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787758938.397279:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758938.397292:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc95dcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787758938.397316:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069010944 00000100:00100000:0.0:1787758938.397321:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069010944 00000100:00100000:0.0:1787758938.397356:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787758938.397366:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601069010944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787758938.397571:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601069010944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 207us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758938.397576:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787758938.397606:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069010944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787758938.397652:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069011072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787758938.397677:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758938.397693:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc95dcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787758938.397720:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069011072 00000100:00100000:1.0:1787758938.397726:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069011072 00000100:00100000:1.0:1787758938.397756:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787758938.397765:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601069011072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787758938.397919:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601069011072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758938.397928:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787758938.397942:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069011072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787758938.398242:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8442:1874601069011200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787758938.398272:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758938.398290:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc95dccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787758938.398310:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069011200 00000100:00100000:0.0:1787758938.398314:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069011200 00000100:00100000:0.0:1787758938.398337:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787758938.398345:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:8442:x1874601069011200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758938.398519:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:8442:x1874601069011200:12345-0@lo:502:llog_process_th.0 Request processed in 175us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758938.398528:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787758938.398544:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8442:1874601069011200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787758938.398574:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8442:1874601069011328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787758938.398596:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758938.398612:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc95dccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758938.398640:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069011328 00000100:00100000:1.0:1787758938.398646:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069011328 00000100:00100000:1.0:1787758938.398675:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787758938.398686:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:8442:x1874601069011328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758938.398826:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:8442:x1874601069011328:12345-0@lo:502:llog_process_th.0 Request processed in 143us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758938.398833:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787758938.398855:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8442:1874601069011328:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787758938.398871:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787758938.398932:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787758938.398956:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787758938.398962:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccf72b9c00/0xa3b7f37aab2d292 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d299 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758938.398972:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99ccf72b9c00/0xa3b7f37aab2d292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d299 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758938.398980:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787758938.398982:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787758938.398985:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787758938.398999:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccfd17b000/0xa3b7f37aab2d2a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758938.399006:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99ccfd17b000/0xa3b7f37aab2d2a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758938.399014:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99ccfd17b000/0xa3b7f37aab2d2a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758938.399026:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069011456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787758938.399053:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758938.399076:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd26d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787758938.399087:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069011456 00000100:00100000:0.0:1787758938.399091:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069011456 00000100:00100000:0.0:1787758938.399123:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787758938.399130:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+15:5818:x1874601069011456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787758938.399136:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758938.399145:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccc0031000/0xa3b7f37aab2d2a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d2a0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758938.399161:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccc0031000/0xa3b7f37aab2d2a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d2a0 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758938.399168:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccc0031000/0xa3b7f37aab2d2a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d2a0 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758938.399173:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0031000, rc 0) 00000100:00100000:0.0:1787758938.399198:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:5818:x1874601069011456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758938.399203:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787758938.399239:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069011456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787758938.399250:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99ccfd17b000/0xa3b7f37aab2d2a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d2a7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758938.399259:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99ccfd17b000/0xa3b7f37aab2d2a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d2a7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758938.399285:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069011584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787758938.399307:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758938.399329:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd26d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758938.399339:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069011584 00000100:00100000:3.0:1787758938.399343:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069011584 00000100:00100000:3.0:1787758938.399366:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787758938.399372:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:5818:x1874601069011584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787758938.399491:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:5818:x1874601069011584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758938.399503:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787758938.399519:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069011584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787758938.399541:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069011712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787758938.399565:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758938.399577:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd26d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787758938.399595:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069011712 00000100:00100000:0.0:1787758938.399599:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069011712 00000100:00100000:0.0:1787758938.399632:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787758938.399639:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:5818:x1874601069011712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787758938.399727:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:5818:x1874601069011712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758938.399739:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787758938.399754:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069011712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787758938.399917:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8443:1874601069011840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758938.399943:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758938.399963:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd26d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787758938.399969:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069011840 00000100:00100000:3.0:1787758938.399973:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069011840 00000100:00100000:3.0:1787758938.399996:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787758938.400002:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7468850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:8443:x1874601069011840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787758938.400109:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7468850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:8443:x1874601069011840:12345-0@lo:502:llog_process_th.0 Request processed in 107us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758938.400116:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787758938.400126:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8443:1874601069011840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787758938.400150:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787758938.400157:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758938.400160:0:8443:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787758938.400164:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787758938.400180:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8443:1874601069011968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758938.400206:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758938.400221:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd26d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787758938.400242:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069011968 00000100:00100000:0.0:1787758938.400246:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069011968 00000100:00100000:0.0:1787758938.400264:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787758938.400268:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:8443:x1874601069011968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758938.400352:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:8443:x1874601069011968:12345-0@lo:502:llog_process_th.0 Request processed in 81us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758938.400360:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8443:1874601069011968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758938.400362:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000020:01000000:1.0:1787758938.400378:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787758938.400382:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758938.400383:0:8443:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787758938.400385:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787758938.400444:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787758938.400458:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787758938.400463:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccfd17b000/0xa3b7f37aab2d2a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d2a7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758938.400471:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99ccfd17b000/0xa3b7f37aab2d2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d2a7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787758938.400479:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787758938.400481:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ccc782b000 from 39 10000000:01000000:3.0:1787758938.400483:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787758938.400495:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8000/0xa3b7f37aab2d2ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758938.400502:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8000/0xa3b7f37aab2d2ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758938.400510:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8000/0xa3b7f37aab2d2ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758938.400520:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069012096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787758938.400546:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758938.400560:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc95dc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758938.400565:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069012096 00000100:00100000:1.0:1787758938.400568:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069012096 00000100:00100000:1.0:1787758938.400596:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787758938.400603:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:5818:x1874601069012096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787758938.400610:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758938.400639:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccfd17b800/0xa3b7f37aab2d2b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d2ae expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758938.400652:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccfd17b800/0xa3b7f37aab2d2b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d2ae expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758938.400660:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccfd17b800/0xa3b7f37aab2d2b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d2ae expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758938.400667:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccfd17b800, rc 0) 00000100:00100000:1.0:1787758938.400693:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069012096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758938.400699:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787758938.400702:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069012096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787758938.400711:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8000/0xa3b7f37aab2d2ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d2b5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758938.400719:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8000/0xa3b7f37aab2d2ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d2b5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758938.400755:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069012224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787758938.400776:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758938.400794:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc95dc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787758938.400811:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069012224 00000100:00100000:0.0:1787758938.400816:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069012224 00000100:00100000:0.0:1787758938.400849:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787758938.400855:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069012224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787758938.400952:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069012224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758938.400959:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787758938.400966:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069012224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787758938.400985:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069012352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787758938.401007:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758938.401021:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc95dc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758938.401035:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069012352 00000100:00100000:1.0:1787758938.401039:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069012352 00000100:00100000:1.0:1787758938.401060:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787758938.401066:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069012352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787758938.401152:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069012352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758938.401159:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787758938.401160:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069012352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787758938.401313:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8444:1874601069012480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758938.401340:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758938.401354:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd26d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787758938.401375:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069012480 00000100:00100000:0.0:1787758938.401378:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069012480 00000100:00100000:0.0:1787758938.401409:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787758938.401417:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:8444:x1874601069012480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758938.401527:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:8444:x1874601069012480:12345-0@lo:502:llog_process_th.0 Request processed in 110us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758938.401533:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787758938.401538:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8444:1874601069012480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758938.401571:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8444:1874601069012608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758938.401592:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758938.401606:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd26d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787758938.401637:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069012608 00000100:00100000:3.0:1787758938.401641:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069012608 00000100:00100000:3.0:1787758938.401662:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787758938.401668:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:8444:x1874601069012608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787758938.401803:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7468c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:8444:x1874601069012608:12345-0@lo:502:llog_process_th.0 Request processed in 134us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758938.401810:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787758938.401823:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfac3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8444:1874601069012608:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787758938.401839:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787758938.401870:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787758938.401885:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787758938.401890:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8000/0xa3b7f37aab2d2ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d2b5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758938.401898:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8000/0xa3b7f37aab2d2ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d2b5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787758938.401905:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787758938.401906:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787758938.401908:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787758938.401920:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8c00/0xa3b7f37aab2d2bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758938.401926:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8c00/0xa3b7f37aab2d2bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758938.401934:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8c00/0xa3b7f37aab2d2bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758938.401944:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069012736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787758938.401965:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758938.401985:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc95dc240 going to sleep for 11 seconds 00000100:00100000:0.0:1787758938.401997:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069012736 00000100:00100000:0.0:1787758938.402000:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069012736 00000100:00100000:0.0:1787758938.402018:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787758938.402022:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069012736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787758938.402031:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758938.402038:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccc0030e00/0xa3b7f37aab2d2c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d2bc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758938.402049:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccc0030e00/0xa3b7f37aab2d2c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d2bc expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758938.402055:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccc0030e00/0xa3b7f37aab2d2c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d2bc expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758938.402060:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030e00, rc 0) 00000100:00100000:0.0:1787758938.402082:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069012736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 60us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758938.402088:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787758938.402099:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069012736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787758938.402108:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8c00/0xa3b7f37aab2d2bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d2c3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758938.402114:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8c00/0xa3b7f37aab2d2bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d2c3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758938.402133:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069012864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787758938.402154:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758938.402168:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc95dc240 going to sleep for 11 seconds 00000100:00100000:1.0:1787758938.402182:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069012864 00000100:00100000:1.0:1787758938.402186:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069012864 00000100:00100000:1.0:1787758938.402208:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787758938.402213:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069012864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787758938.402328:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7424c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069012864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758938.402335:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787758938.402347:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069012864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787758938.402367:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069012992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787758938.402392:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758938.402419:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc95dc240 going to sleep for 11 seconds 00000100:00100000:0.0:1787758938.402431:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069012992 00000100:00100000:0.0:1787758938.402434:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069012992 00000100:00100000:0.0:1787758938.402452:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787758938.402456:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069012992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787758938.402558:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7426050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069012992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758938.402564:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069012992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787758938.402565:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787758938.402766:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8445:1874601069013120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787758938.402789:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758938.402804:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc95dc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758938.402811:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069013120 00000100:00100000:1.0:1787758938.402817:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069013120 00000100:00100000:1.0:1787758938.402847:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787758938.402855:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:8445:x1874601069013120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758938.402990:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7427c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:8445:x1874601069013120:12345-0@lo:502:llog_process_th.0 Request processed in 134us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758938.402992:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8445:1874601069013120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758938.403002:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000020:01000000:3.0:1787758938.403009:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787758938.403013:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787758938.403014:0:8445:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787758938.403018:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787758938.403030:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8445:1874601069013248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787758938.403052:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758938.403063:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc95dc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787758938.403080:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069013248 00000100:00100000:0.0:1787758938.403084:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069013248 00000100:00100000:0.0:1787758938.403102:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787758938.403108:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:8445:x1874601069013248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758938.403213:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7425c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:8445:x1874601069013248:12345-0@lo:502:llog_process_th.0 Request processed in 105us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758938.403220:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5883480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8445:1874601069013248:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787758938.403232:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1787758938.403233:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000020:00000080:3.0:1787758938.403237:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787758938.403239:0:8445:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787758938.403242:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1787758938.403275:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787758938.403289:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787758938.403292:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8c00/0xa3b7f37aab2d2bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d2c3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758938.403298:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8c00/0xa3b7f37aab2d2bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d2c3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787758938.403302:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787758938.403304:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99ccd06d3800 from 39 10000000:01000000:0.0:1787758938.403305:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787758938.403323:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccc0030600/0xa3b7f37aab2d2ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758938.403328:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99ccc0030600/0xa3b7f37aab2d2ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758938.403335:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99ccc0030600/0xa3b7f37aab2d2ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758938.403347:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1091a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069013376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787758938.403369:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758938.403384:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc7772000 going to sleep for 11 seconds 00000100:00100000:1.0:1787758938.403416:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069013376 00000100:00100000:1.0:1787758938.403421:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069013376 00000100:00100000:1.0:1787758938.403449:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787758938.403457:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069013376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787758938.403472:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758938.403482:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccfd17ae00/0xa3b7f37aab2d2d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d2ca expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758938.403503:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccfd17ae00/0xa3b7f37aab2d2d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d2ca expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758938.403512:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccfd17ae00/0xa3b7f37aab2d2d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d2ca expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758938.403519:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccfd17ae00, rc 0) 00000100:00100000:1.0:1787758938.403553:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7425450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069013376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758938.403560:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787758938.403580:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1091a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069013376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787758938.403591:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99ccc0030600/0xa3b7f37aab2d2ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d2d1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758938.403599:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99ccc0030600/0xa3b7f37aab2d2ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d2d1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758938.403655:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1091a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069013504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787758938.403672:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758938.403688:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc7772000 going to sleep for 11 seconds 00000100:00100000:2.0:1787758938.403714:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069013504 00000100:00100000:2.0:1787758938.403720:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069013504 00000100:00100000:2.0:1787758938.403748:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787758938.403757:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069013504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787758938.403887:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7425850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069013504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758938.403895:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787758938.403908:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1091a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069013504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787758938.403927:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1091a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069013632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787758938.403953:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758938.403969:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc7772000 going to sleep for 11 seconds 00000100:00100000:1.0:1787758938.403990:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069013632 00000100:00100000:1.0:1787758938.403994:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069013632 00000100:00100000:1.0:1787758938.404020:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787758938.404029:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069013632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787758938.404127:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7425050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069013632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758938.404134:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787758938.404190:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1091a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069013632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787758938.404432:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1091a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8446:1874601069013760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758938.404464:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758938.404481:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff99cccfd2e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787758938.404507:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069013760 00000100:00100000:2.0:1787758938.404513:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069013760 00000100:00100000:2.0:1787758938.404545:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787758938.404554:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:8446:x1874601069013760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787758938.404707:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7426c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:8446:x1874601069013760:12345-0@lo:502:llog_process_th.0 Request processed in 153us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758938.404716:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787758938.404724:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1091a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8446:1874601069013760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758938.404758:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1091a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8446:1874601069013888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758938.404788:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758938.404811:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff99cccfd2e000 going to sleep for 11 seconds 00000100:00100000:1.0:1787758938.404822:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069013888 00000100:00100000:1.0:1787758938.404828:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069013888 00000100:00100000:1.0:1787758938.404855:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787758938.404862:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:8446:x1874601069013888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758938.404994:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7424450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:8446:x1874601069013888:12345-0@lo:502:llog_process_th.0 Request processed in 132us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758938.405002:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787758938.405013:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1091a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8446:1874601069013888:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787758938.405030:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787758938.405075:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787758938.405087:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787758938.405095:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccc0030600/0xa3b7f37aab2d2ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d2d1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758938.405101:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99ccc0030600/0xa3b7f37aab2d2ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d2d1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758938.490759:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758938.490831:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062698752 00000100:00100000:0.0:1787758938.490840:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062698752 00000100:00100000:0.0:1787758938.490892:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 153 00000100:00100000:0.0:1787758938.490900:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+8:5588:x1874601062698752:12345-192.168.201.54@tcp:101: 00010000:00010000:0.0:1787758938.490915:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758938.490941:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccc0031200/0xa3b7f37aab2d2d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8754 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758938.490963:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccc0031200/0xa3b7f37aab2d2d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8754 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758938.490971:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccc0031200/0xa3b7f37aab2d2d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8754 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758938.490977:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0031200, rc 0) 00000100:00100000:0.0:1787758938.491019:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7427450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+9:5588:x1874601062698752:12345-192.168.201.54@tcp:101: Request processed in 120us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758938.491023:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 153 00000100:00100000:3.0:1787758938.491914:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758938.491974:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062698880 00000100:00100000:1.0:1787758938.491980:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062698880 00000100:00100000:1.0:1787758938.492024:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 154 00000100:00100000:1.0:1787758938.492033:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5453e3da-9a83-4395-adba-03dea8a5243b+9:5588:x1874601062698880:12345-192.168.201.54@tcp:501: 00000100:00100000:1.0:1787758938.492276:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7424850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5453e3da-9a83-4395-adba-03dea8a5243b+9:5588:x1874601062698880:12345-192.168.201.54@tcp:501: Request processed in 244us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758938.492284:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 154 00000100:00100000:3.0:1787758938.492953:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758938.493017:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062699008 00000100:00100000:0.0:1787758938.493024:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062699008 00000100:00100000:0.0:1787758938.493061:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 155 00000100:00100000:0.0:1787758938.493068:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+9:5588:x1874601062699008:12345-192.168.201.54@tcp:503: 00000100:00100000:0.0:1787758938.493249:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7426850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+9:5588:x1874601062699008:12345-192.168.201.54@tcp:503: Request processed in 181us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758938.493255:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 155 00000100:00100000:2.0:1787758938.494211:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758938.494264:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062699136 00000100:00100000:1.0:1787758938.494270:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062699136 00000100:00100000:1.0:1787758938.494309:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 156 00000100:00100000:1.0:1787758938.494318:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5453e3da-9a83-4395-adba-03dea8a5243b+9:6059:x1874601062699136:12345-192.168.201.54@tcp:502: 00000100:00100000:1.0:1787758938.494543:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7427850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5453e3da-9a83-4395-adba-03dea8a5243b+9:6059:x1874601062699136:12345-192.168.201.54@tcp:502: Request processed in 226us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758938.494552:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 156 00000100:00100000:3.0:1787758938.495143:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758938.495178:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062699264 00000100:00100000:0.0:1787758938.495184:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062699264 00000100:00100000:0.0:1787758938.495213:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 157 00000100:00100000:0.0:1787758938.495219:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+9:6059:x1874601062699264:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787758938.495346:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7426450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+9:6059:x1874601062699264:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 127us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758938.495351:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 157 00000100:00100000:3.0:1787758938.496127:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758938.496177:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062699392 00000100:00100000:1.0:1787758938.496184:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062699392 00000100:00100000:1.0:1787758938.496222:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 158 00000100:00100000:1.0:1787758938.496230:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5453e3da-9a83-4395-adba-03dea8a5243b+9:5588:x1874601062699392:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787758938.496240:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758938.496254:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccfd17be00/0xa3b7f37aab2d2df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ab477154fea875b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758938.496275:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccfd17be00/0xa3b7f37aab2d2df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea875b expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758938.496285:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccfd17be00/0xa3b7f37aab2d2df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea875b expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758938.496294:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccfd17be00, rc 0) 00000100:00100000:1.0:1787758938.496333:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7427050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5453e3da-9a83-4395-adba-03dea8a5243b+10:5588:x1874601062699392:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 Request processed in 103us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758938.496342:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 158 00000100:00100000:2.0:1787758938.496873:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758938.496911:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062699520 00000100:00100000:0.0:1787758938.496916:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062699520 00000100:00100000:0.0:1787758938.496941:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 159 00000100:00100000:0.0:1787758938.496946:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+10:5588:x1874601062699520:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787758938.497148:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7424050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+10:5588:x1874601062699520:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 Request processed in 199us (275us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787758938.497155:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 159 00000100:00100000:3.0:1787758939.002527:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758939.002570:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758939.002591:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758939.002606:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062699776 00000100:00100000:0.0:1787758939.002661:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062699776 00000100:00100000:1.0:1787758939.002666:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062699648 00000100:00100000:2.0:1787758939.002670:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062700032 00000100:00100000:1.0:1787758939.002674:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062699648 00000100:00100000:3.0:1787758939.002681:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758939.002682:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062700032 00000100:00100000:1.0:1787758939.002742:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 160 00000100:00100000:3.0:1787758939.002743:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062699904 00000100:00100000:3.0:1787758939.002754:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062699904 00000100:00100000:0.0:1787758939.002755:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:2.0:1787758939.002755:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:1.0:1787758939.002761:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7420050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5453e3da-9a83-4395-adba-03dea8a5243b+10:2358:x1874601062699648:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1787758939.002775:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+6:2359:x1874601062699776:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1787758939.002776:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf58830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33089637-5953-4edf-8e89-39ecfabcd268+5:2359:x1874601062700032:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1787758939.002824:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:3.0:1787758939.002840:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5881a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33089637-5953-4edf-8e89-39ecfabcd268+5:2358:x1874601062699904:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1787758939.002850:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7420050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5453e3da-9a83-4395-adba-03dea8a5243b+10:2358:x1874601062699648:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 89us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758939.002853:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+6:2359:x1874601062699776:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 78us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758939.002853:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf58830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33089637-5953-4edf-8e89-39ecfabcd268+5:2359:x1874601062700032:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 78us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758939.002867:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 160 00000100:00100000:0.0:1787758939.002871:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:2.0:1787758939.002871:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00080000:0.0:1787758939.002899:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787758939.002904:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787758939.002906:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787758939.002918:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5881a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33089637-5953-4edf-8e89-39ecfabcd268+5:2358:x1874601062699904:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 81us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758939.002927:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 5 00010000:00010000:3.0:1787758939.164791:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787758939.497706:0:8484:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc3ba0b40 20000000:00000080:1.0:1787758939.497722:0:8484:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ccfd0b9c00 uarg=0000000000000000 20000000:01000000:1.0:1787758939.497755:0:8484:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787758939.497761:0:8484:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787758939.497766:0:8484:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787758939.498250:0:8485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787758939.498320:0:8484:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787758939.500042:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787758939.500072:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787758939.500099:0:8484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787758939.500108:0:8484:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787758939.500122:0:8484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2e6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758939.500135:0:8484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cd02047000/0xa3b7f37aab2d0af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d0a8 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758939.500140:0:8484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cd02047c00/0xa3b7f37aab2d12d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d126 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758939.500144:0:8484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccd96fd200/0xa3b7f37aab2d188 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d181 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758939.500150:0:8484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccd96fc800/0xa3b7f37aab2d245 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8723 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758939.500154:0:8484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2e6 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758939.500181:0:8484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccd96fc800/0xa3b7f37aab2d245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8723 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758939.500191:0:8484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99ccd96fc800/0xa3b7f37aab2d245 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8723 expref: 9 pid: 5816 timeout: 189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758939.500201:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56db480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874601069014016:192.168.201.54@tcp:104: 00010000:00010000:2.0:1787758939.500278:0:8484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccd96fd200/0xa3b7f37aab2d188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d181 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758939.500290:0:8484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ccd96fd200/0xa3b7f37aab2d188 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d181 expref: 18 pid: 5815 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758939.500296:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d9a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874601069014144:0@lo:104: 00000100:00100000:2.0:1787758939.500325:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787758939.500365:0:8484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cd02047c00/0xa3b7f37aab2d12d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d126 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758939.500374:0:8484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cd02047c00/0xa3b7f37aab2d12d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d126 expref: 18 pid: 5816 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758939.500376:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069014144 00000100:00100000:0.0:1787758939.500397:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069014144 00000100:00100000:2.0:1787758939.500401:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874601069014272:0@lo:104: 00000100:00100000:2.0:1787758939.500433:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758939.500458:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787758939.500465:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00010000:00010000:2.0:1787758939.500469:0:8484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cd02047000/0xa3b7f37aab2d0af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d0a8 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758939.500473:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069014272 00000100:00100000:0.0:1787758939.500477:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069014272 00000100:00100000:1.0:1787758939.500482:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1787758939.500482:0:8484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99cd02047000/0xa3b7f37aab2d0af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0a8 expref: 18 pid: 5815 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758939.500494:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874601069014400:0@lo:104: 00000100:00100000:1.0:1787758939.500497:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+4:8484:x1874601069014144:12345-0@lo:104: 00000100:00100000:0.0:1787758939.500502:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787758939.500512:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf58de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+4:8484:x1874601069014272:12345-0@lo:104: 00010000:00010000:1.0:1787758939.500513:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99cd02047a00/0xa3b7f37aab2d181 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d188 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.500525:0:6684:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d126 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d12d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758939.500526:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758939.500537:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069014400 00000100:00100000:3.0:1787758939.500542:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069014400 00000100:00100000:2.0:1787758939.500543:0:8484:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8b89300 going to sleep for 11 seconds 00000100:00100000:3.0:1787758939.500574:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787758939.500584:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787758939.500587:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:8484:x1874601069014400:12345-0@lo:104: 00000100:00100000:1.0:1787758939.500590:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:8484:x1874601069014144:12345-0@lo:104: Request processed in 99us (263us total) trans 0 rc 0/0 00010000:00010000:0.0:1787758939.500593:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787758939.500597:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d9a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874601069014144:0@lo:104: 00010000:00010000:3.0:1787758939.500602:0:8425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d0a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d0af expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758939.500603:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787758939.500609:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf58de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:8484:x1874601069014272:12345-0@lo:104: Request processed in 98us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758939.500612:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874601069014272:0@lo:104: 00000100:00100000:0.0:1787758939.500634:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1787758939.500667:0:7614:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787758939.500672:0:7614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99cd02047a00/0xa3b7f37aab2d181 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d188 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.500677:0:6685:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787758939.500681:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d126 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d12d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758939.500685:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787758939.500694:0:7614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cd02047a00 already unused, calling callback (ffffffffc1c61c20) 00000100:00100000:3.0:1787758939.500695:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+3:8484:x1874601069014400:12345-0@lo:104: Request processed in 112us (172us total) trans 0 rc 0/0 00010000:00010000:0.0:1787758939.500698:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cccf888000 already unused, calling callback (ffffffffc1c61c20) 10000000:00010000:2.0:1787758939.500701:0:7614:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99cd02047a00/0xa3b7f37aab2d181 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d188 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758939.500703:0:6685:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d126 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d12d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758939.500710:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787758939.500718:0:6685:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d12d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787758939.500728:0:6685:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d12d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758939.500730:0:7614:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99cd02047a00/0xa3b7f37aab2d181 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d188 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758939.500731:0:8427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:0.0:1787758939.500732:0:6685:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787758939.500738:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d0a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d0af expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787758939.500742:0:7614:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99cd02047a00/0xa3b7f37aab2d181 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d188 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758939.500749:0:7614:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787758939.500753:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cccf888200 already unused, calling callback (ffffffffc1c61c20) 10000000:00010000:3.0:1787758939.500757:0:8427:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d0a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d0af expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.500761:0:6685:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d126 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d12d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758939.500763:0:8427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d0a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d0af expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758939.500767:0:7614:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99cd02047a00/0xa3b7f37aab2d181 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d188 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.500772:0:6685:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787758939.500777:0:7614:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787758939.500792:0:7614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99cd02047a00/0xa3b7f37aab2d181 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d188 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.500796:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d126 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d12d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758939.500798:0:7614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99cd02047a00/0xa3b7f37aab2d181 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d188 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.500810:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d126 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d12d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758939.500812:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1092d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3293:1874601069014528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787758939.500816:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758939.500822:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758939.500822:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758939.500827:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758939.500827:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758939.500831:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787758939.500838:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601069014656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787758939.500849:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758939.500882:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069014528 00000100:00100000:2.0:1787758939.500882:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874601069014400:0@lo:104: 00000100:00100000:0.0:1787758939.500887:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069014528 00010000:00010000:0.0:1787758939.500904:0:6686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cd02047c00/0xa3b7f37aab2d12d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d126 expref: 19 pid: 5816 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758939.500915:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1787758939.500921:0:8427:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d0a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d0af expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787758939.500926:0:8427:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787758939.500927:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069014656 00000100:00100000:0.0:1787758939.500931:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069014656 00000100:00100000:1.0:1787758939.500939:0:7615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1787758939.500944:0:6686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccd96fd200/0xa3b7f37aab2d188 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d181 expref: 20 pid: 5815 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758939.500950:0:7615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+20:3293:x1874601069014528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787758939.500958:0:8427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d0a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d0af expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758939.500959:0:7615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787758939.500966:0:7615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cd02047c00/0xa3b7f37aab2d12d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d126 expref: 20 pid: 5816 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758939.500969:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787758939.500973:0:8427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787758939.500981:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56d9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+20:3290:x1874601069014656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787758939.500982:0:7615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cd02047c00/0xa3b7f37aab2d12d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d126 expref: 20 pid: 5816 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.500991:0:6686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787758939.500996:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d0a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d0af expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.500997:0:6686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccd96fd200/0xa3b7f37aab2d188 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d181 expref: 20 pid: 5815 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758939.500998:0:7615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd02047c00/0xa3b7f37aab2d12d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d126 expref: 20 pid: 5816 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758939.501012:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5883840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3291:1874601069014784:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787758939.501017:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d0a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d0af expref: -99 pid: 6666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.501023:0:6686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccd96fd200/0xa3b7f37aab2d188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d181 expref: 19 pid: 5815 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758939.501036:0:7615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787758939.501042:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccd96fd200/0xa3b7f37aab2d188 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d181 expref: 19 pid: 5815 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758939.501054:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787758939.501055:0:6686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787758939.501056:0:8427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758939.501061:0:8427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758939.501064:0:8427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758939.501071:0:7615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:3293:x1874601069014528:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758939.501077:0:7615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787758939.501095:0:7615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069014784 00000100:00100000:1.0:1787758939.501098:0:7615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069014784 00000100:00100000:0.0:1787758939.501100:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56d9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:3290:x1874601069014656:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758939.501107:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787758939.501111:0:7615:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cd02047000/0xa3b7f37aab2d0af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0a8 expref: 18 pid: 5815 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758939.501123:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601069014656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787758939.501133:0:7615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787758939.501140:0:7615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56db840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:3291:x1874601069014784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787758939.501145:0:7615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787758939.501149:0:7615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cd02047000/0xa3b7f37aab2d0af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0a8 expref: 17 pid: 5815 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758939.501155:0:7615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cd02047000/0xa3b7f37aab2d0af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d0a8 expref: 17 pid: 5815 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758939.501169:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1092d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3293:1874601069014528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787758939.501172:0:7615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cd02047000/0xa3b7f37aab2d0af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d0a8 expref: 17 pid: 5815 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758939.501182:0:7615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787758939.501206:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56db480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8484:1874601069014016:192.168.201.54@tcp:104: 00000100:00100000:1.0:1787758939.501218:0:7615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56db840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:3291:x1874601069014784:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758939.501224:0:7615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1787758939.501237:0:8484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2e6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758939.501240:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5883840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3291:1874601069014784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787758939.501471:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758939.501501:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062700160 00000100:00100000:0.0:1787758939.501508:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062700160 00010000:00010000:0.0:1787758939.501520:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccd96fc800/0xa3b7f37aab2d245 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8723 expref: 10 pid: 5816 timeout: 189 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758939.501538:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 23 00000100:00100000:0.0:1787758939.501542:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5453e3da-9a83-4395-adba-03dea8a5243b+10:2356:x1874601062700160:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787758939.501547:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787758939.501550:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccd96fc800/0xa3b7f37aab2d245 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8723 expref: 10 pid: 5816 timeout: 189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.501556:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccd96fc800/0xa3b7f37aab2d245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8723 expref: 10 pid: 5816 timeout: 189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.501564:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccd96fc800/0xa3b7f37aab2d245 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8723 expref: 10 pid: 5816 timeout: 189 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.501572:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2e6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.501577:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2e6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.501584:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2e6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.501588:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2e6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.501592:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2e6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.501602:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2e6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.501605:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cccf889000 already unused, calling callback (ffffffffc1666530) 00010000:00010000:0.0:1787758939.501608:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2e6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.501612:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2e6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.501637:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2e6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758939.501643:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787758939.501663:0:8484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2e6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758939.501667:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5453e3da-9a83-4395-adba-03dea8a5243b+9:2356:x1874601062700160:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 123us (197us total) trans 0 rc 0/0 00010000:00010000:2.0:1787758939.501678:0:8484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2e6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758939.501679:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 23 00010000:00010000:2.0:1787758939.501688:0:8484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2e6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758939.541298:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758939.541335:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062700288 00000100:00100000:2.0:1787758939.541344:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062700288 00000100:00100000:2.0:1787758939.541403:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 161 00000100:00100000:2.0:1787758939.541416:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7420c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+9:5588:x1874601062700288:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787758939.541433:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758939.541448:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8762 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758939.541477:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8762 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758939.541486:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8762 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758939.541500:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cccf889000, rc 0) 00000100:00100000:2.0:1787758939.541554:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7420c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+10:5588:x1874601062700288:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 Request processed in 142us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758939.541561:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 161 00000100:00100000:3.0:1787758939.542171:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758939.542204:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062700416 00000100:00100000:1.0:1787758939.542208:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062700416 00000100:00100000:1.0:1787758939.542241:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 162 00000100:00100000:1.0:1787758939.542250:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7422050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:5588:x1874601062700416:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787758939.542487:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7422050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:5588:x1874601062700416:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 Request processed in 238us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758939.542493:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 162 00000100:00100000:3.0:1787758939.543017:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758939.543052:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062700544 00000100:00100000:1.0:1787758939.543057:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062700544 00000100:00100000:1.0:1787758939.543088:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 163 00000100:00100000:1.0:1787758939.543096:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7423c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+10:5588:x1874601062700544:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787758939.543275:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7423c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+10:5588:x1874601062700544:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 Request processed in 178us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758939.543282:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 163 00000100:00100000:3.0:1787758939.544018:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758939.544046:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062700672 00000100:00100000:1.0:1787758939.544050:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062700672 00000100:00100000:1.0:1787758939.544076:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 164 00000100:00100000:1.0:1787758939.544086:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7421c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:6095:x1874601062700672:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787758939.544278:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7421c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:6095:x1874601062700672:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 193us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758939.544286:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 164 00000100:00100000:3.0:1787758939.544816:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758939.544848:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062700800 00000100:00100000:2.0:1787758939.544853:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062700800 00000100:00100000:2.0:1787758939.544886:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 165 00000100:00100000:2.0:1787758939.544895:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7421450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+10:6095:x1874601062700800:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787758939.544999:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7421450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+10:6095:x1874601062700800:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 105us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758939.545007:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 165 00010000:00010000:3.0:1787758940.188703:0:8426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758940.316828:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787758940.316860:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5883c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069014912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787758940.316949:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758940.317006:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069014912 00000100:00100000:1.0:1787758940.317021:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069014912 00000100:00080000:3.0:1787758940.317085:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787758940.317102:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787758940.317113:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1787758940.317116:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1092d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069014912:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787758940.317128:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1787758940.317165:0:6672:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787758940.317253:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1092d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069014912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758940.317261:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787758940.317309:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf5883c00 x1874601069014912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758940.317337:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5883c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069014912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787758941.212784:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787758941.239597:0:8775:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing check_logdir /tmp/testlogs/ 10000000:01000000:2.0:1787758941.404666:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787758941.404674:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ccffe2e000 from 4 10000000:01000000:2.0:1787758941.404678:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787758941.404728:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d2f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758941.404739:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d2f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758941.404748:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d2f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758941.404773:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069015040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787758941.404868:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758941.404922:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069015040 00000100:00100000:2.0:1787758941.404925:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8b896c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758941.404931:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069015040 00000100:00100000:1.0:1787758941.404986:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787758941.404996:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7421850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:5818:x1874601069015040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787758941.405010:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758941.405023:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccfd17aa00/0xa3b7f37aab2d2fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d2f4 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758941.405046:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccfd17aa00/0xa3b7f37aab2d2fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d2f4 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758941.405056:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccfd17aa00/0xa3b7f37aab2d2fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d2f4 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758941.405064:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccfd17aa00, rc 0) 00000100:00100000:1.0:1787758941.405113:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7421850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069015040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758941.405122:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787758941.405142:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069015040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787758941.405157:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d2f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d2fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758941.405168:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d2f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d2fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758941.405223:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069015168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787758941.405243:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758941.405258:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8b896c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758941.405276:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069015168 00000100:00100000:1.0:1787758941.405280:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069015168 00000100:00100000:1.0:1787758941.405302:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787758941.405308:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7421050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069015168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787758941.405542:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7421050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069015168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758941.405548:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787758941.405576:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069015168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787758941.405608:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069015296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787758941.405668:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758941.405695:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8b896c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758941.405704:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069015296 00000100:00100000:1.0:1787758941.405708:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069015296 00000100:00100000:1.0:1787758941.405729:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787758941.405735:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7422c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069015296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787758941.405869:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7422c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069015296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758941.405874:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787758941.405897:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069015296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787758941.406171:0:8796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfaed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8796:1874601069015424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758941.406197:0:8796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758941.406210:0:8796:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfcfb2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787758941.406230:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069015424 00000100:00100000:2.0:1787758941.406234:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069015424 00000100:00100000:2.0:1787758941.406255:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787758941.406259:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7420450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:8796:x1874601069015424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787758941.406373:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7420450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:8796:x1874601069015424:12345-0@lo:502:llog_process_th.0 Request processed in 112us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758941.406381:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787758941.406404:0:8796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfaed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8796:1874601069015424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787758941.406424:0:8796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787758941.406433:0:8796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758941.406435:0:8796:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787758941.406440:0:8796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ccffe2e000 00000020:00000080:1.0:1787758941.406442:0:8796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787758941.406503:0:8796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfaed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8796:1874601069015552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758941.406531:0:8796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758941.406547:0:8796:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfcfb2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787758941.406572:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069015552 00000100:00100000:2.0:1787758941.406581:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069015552 00000100:00100000:2.0:1787758941.406604:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787758941.406611:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7423450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:8796:x1874601069015552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787758941.406714:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7423450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:8796:x1874601069015552:12345-0@lo:502:llog_process_th.0 Request processed in 104us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758941.406721:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787758941.406737:0:8796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfaed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8796:1874601069015552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787758941.406755:0:8796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787758941.406759:0:8796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787758941.406760:0:8796:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787758941.406763:0:8796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787758941.406820:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787758941.406835:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787758941.406841:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d2f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d2fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758941.406849:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d2f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d2fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758941.406857:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787758941.406859:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ccc782b000 from 4 10000000:01000000:2.0:1787758941.406860:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787758941.406874:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d302 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758941.406880:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d302 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758941.406886:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d302 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758941.406898:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069015680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787758941.406929:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758941.406954:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069015680 00000100:00100000:2.0:1787758941.406957:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8b89480 going to sleep for 11 seconds 00000100:00100000:1.0:1787758941.406959:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069015680 00000100:00100000:1.0:1787758941.406997:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787758941.407007:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7420850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069015680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787758941.407013:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758941.407021:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccfd17bc00/0xa3b7f37aab2d309 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d302 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758941.407033:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccfd17bc00/0xa3b7f37aab2d309 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d302 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758941.407040:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccfd17bc00/0xa3b7f37aab2d309 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d302 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758941.407045:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccfd17bc00, rc 0) 00000100:00100000:1.0:1787758941.407080:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7420850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069015680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758941.407086:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787758941.407092:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069015680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787758941.407107:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d302 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d309 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758941.407113:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d302 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d309 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758941.407144:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069015808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787758941.407170:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758941.407183:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8b89480 going to sleep for 11 seconds 00000100:00100000:1.0:1787758941.407193:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069015808 00000100:00100000:1.0:1787758941.407198:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069015808 00000100:00100000:1.0:1787758941.407223:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787758941.407230:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7422850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069015808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787758941.407372:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7422850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069015808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758941.407378:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787758941.407408:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069015808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787758941.407430:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069015936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787758941.407466:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758941.407480:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc8b89480 going to sleep for 11 seconds 00000100:00100000:1.0:1787758941.407482:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069015936 00000100:00100000:1.0:1787758941.407485:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069015936 00000100:00100000:1.0:1787758941.407507:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787758941.407513:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7423850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069015936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787758941.407609:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7423850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069015936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758941.407628:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069015936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787758941.407641:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787758941.407879:0:8797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8797:1874601069016064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758941.407923:0:8797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758941.407953:0:8797:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfc8a9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787758941.407967:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069016064 00000100:00100000:1.0:1787758941.407973:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069016064 00000100:00100000:1.0:1787758941.408005:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787758941.408012:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7422450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:8797:x1874601069016064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758941.408134:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7422450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:8797:x1874601069016064:12345-0@lo:502:llog_process_th.0 Request processed in 122us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758941.408141:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787758941.408165:0:8797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8797:1874601069016064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787758941.408197:0:8797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787758941.408204:0:8797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758941.408206:0:8797:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787758941.408212:0:8797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ccc782b000 00000020:00000080:0.0:1787758941.408215:0:8797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787758941.408259:0:8797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8797:1874601069016192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758941.408295:0:8797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758941.408316:0:8797:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfc8a9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787758941.408331:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069016192 00000100:00100000:1.0:1787758941.408336:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069016192 00000100:00100000:1.0:1787758941.408384:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787758941.408392:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7423050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:8797:x1874601069016192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758941.408509:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7423050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:8797:x1874601069016192:12345-0@lo:502:llog_process_th.0 Request processed in 118us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758941.408517:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787758941.408543:0:8797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8797:1874601069016192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787758941.408563:0:8797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787758941.408569:0:8797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758941.408571:0:8797:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787758941.408575:0:8797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787758941.408642:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787758941.408659:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787758941.408671:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d302 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d309 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758941.408681:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d302 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d309 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758941.408690:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787758941.408692:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ccd06d3800 from 4 10000000:01000000:1.0:1787758941.408694:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787758941.408712:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a000/0xa3b7f37aab2d310 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758941.408721:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a000/0xa3b7f37aab2d310 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758941.408729:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a000/0xa3b7f37aab2d310 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758941.408743:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfaed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069016320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787758941.408771:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758941.408790:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfcfb2840 going to sleep for 11 seconds 00000100:00100000:0.0:1787758941.408805:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069016320 00000100:00100000:0.0:1787758941.408810:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069016320 00000100:00100000:0.0:1787758941.408843:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787758941.408853:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069016320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787758941.408861:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758941.408870:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccc0030200/0xa3b7f37aab2d317 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d310 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758941.408885:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccc0030200/0xa3b7f37aab2d317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d310 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758941.408894:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccc0030200/0xa3b7f37aab2d317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d310 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758941.408902:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030200, rc 0) 00000100:00100000:0.0:1787758941.408939:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069016320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758941.408945:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfaed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069016320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787758941.408957:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00010000:00010000:1.0:1787758941.408959:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a000/0xa3b7f37aab2d310 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d317 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758941.408966:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a000/0xa3b7f37aab2d310 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d317 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758941.408996:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfaed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069016448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787758941.409024:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758941.409037:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfcfb2840 going to sleep for 11 seconds 00000100:00100000:0.0:1787758941.409048:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069016448 00000100:00100000:0.0:1787758941.409054:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069016448 00000100:00100000:1.0:1787758941.409083:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787758941.409092:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069016448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787758941.409226:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069016448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758941.409232:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787758941.409245:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfaed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069016448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787758941.409275:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069016576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787758941.409326:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758941.409344:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069016576 00000100:00100000:0.0:1787758941.409345:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfc8a9180 going to sleep for 11 seconds 00000100:00100000:1.0:1787758941.409360:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069016576 00000100:00100000:1.0:1787758941.409381:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787758941.409387:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069016576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787758941.409468:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069016576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758941.409474:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787758941.409485:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069016576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787758941.409703:0:8799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8799:1874601069016704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758941.409732:0:8799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758941.409750:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069016704 00000100:00100000:0.0:1787758941.409754:0:8799:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfc8a9540 going to sleep for 11 seconds 00000100:00100000:1.0:1787758941.409755:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069016704 00000100:00100000:1.0:1787758941.409782:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787758941.409788:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:8799:x1874601069016704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758941.409905:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:8799:x1874601069016704:12345-0@lo:502:llog_process_th.0 Request processed in 115us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758941.409913:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787758941.409916:0:8799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8799:1874601069016704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787758941.409941:0:8799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787758941.409947:0:8799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758941.409949:0:8799:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787758941.409957:0:8799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99ccd06d3800 00000020:00000080:0.0:1787758941.409961:0:8799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787758941.410006:0:8799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8799:1874601069016832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787758941.410035:0:8799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758941.410047:0:8799:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfc8a9540 going to sleep for 11 seconds 00000100:00100000:1.0:1787758941.410057:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069016832 00000100:00100000:1.0:1787758941.410063:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069016832 00000100:00100000:1.0:1787758941.410097:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787758941.410107:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:8799:x1874601069016832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758941.410247:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:8799:x1874601069016832:12345-0@lo:502:llog_process_th.0 Request processed in 143us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758941.410254:0:8799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:8799:1874601069016832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787758941.410263:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000020:01000000:0.0:1787758941.410275:0:8799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787758941.410280:0:8799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787758941.410281:0:8799:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787758941.410285:0:8799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787758941.410319:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787758941.410345:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787758941.410359:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a000/0xa3b7f37aab2d310 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d317 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758941.410365:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a000/0xa3b7f37aab2d310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d317 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758941.852792:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069017088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787758941.852792:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601069016960:0@lo:400:kworker.0 00000100:00100000:1.0:1787758941.852838:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874601069017216:0@lo:400:kworker.0 00000100:00100000:2.0:1787758941.852889:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758941.852891:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758941.852891:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758941.852949:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1874601069017728:0@lo:400:kworker.0 00000100:00100000:0.0:1787758941.852960:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069017472:0@lo:400:kworker.0 00000100:00100000:2.0:1787758941.852962:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1874601069017600:0@lo:400:kworker.0 00000100:00100000:1.0:1787758941.852986:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758941.853005:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069017088 00000100:00100000:2.0:1787758941.853010:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758941.853012:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069017088 00000100:00100000:1.0:1787758941.853039:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069017216 00000100:00100000:1.0:1787758941.853045:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069017216 00000100:00100000:2.0:1787758941.853055:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfaed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1874601069017344:0@lo:400:kworker.0 00000100:00100000:0.0:1787758941.853080:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787758941.853087:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069017600 00000100:00100000:2.0:1787758941.853090:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758941.853093:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069017600 00000100:00100000:0.0:1787758941.853095:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1091e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069017088:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787758941.853129:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069017344 00000100:00100000:2.0:1787758941.853133:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069016960 00000100:00100000:1.0:1787758941.853134:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069017344 00000100:00100000:2.0:1787758941.853137:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069016960 00002000:00000024:0.0:1787758941.853143:0:6672:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787758941.853169:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787758941.853177:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787758941.853183:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc69683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874601069017216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787758941.853187:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3290:x1874601069016960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787758941.853201:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1091e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069017088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758941.853210:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787758941.853240:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787758941.853243:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc69683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1874601069017216:12345-0@lo:400:kworker.0 Request processed in 64us (358us total) trans 0 rc 0/0 00000100:00080000:0.0:1787758941.853247:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787758941.853250:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3290:x1874601069016960:12345-0@lo:400:kworker.0 Request processed in 64us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758941.853259:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787758941.853262:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787758941.853267:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787758941.853278:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1874601069017600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758941.853283:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787758941.853294:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874601069017344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787758941.853304:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069017728 00000100:00100000:2.0:1787758941.853310:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069017728 00000100:00100000:0.0:1787758941.853335:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1874601069017600:12345-0@lo:400:kworker.0 Request processed in 59us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758941.853356:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787758941.853356:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874601069017344:12345-0@lo:400:kworker.0 Request processed in 48us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758941.853361:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787758941.853376:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787758941.853377:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1874601069017728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787758941.853392:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758941.853425:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3291:1874601069017216:0@lo:400:kworker.0 00000100:00100000:2.0:1787758941.853427:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1874601069017728:12345-0@lo:400:kworker.0 Request processed in 55us (440us total) trans 0 rc 0/0 00010000:00080000:0.0:1787758941.853437:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cce1093c00 x1874601069017088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758941.853440:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787758941.853443:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccfcfae580 x1874601069017728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758941.853457:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069017472 00000100:00100000:2.0:1787758941.853462:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069017472 00000100:00100000:1.0:1787758941.853466:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1874601069017728:0@lo:400:kworker.0 00000100:00100000:0.0:1787758941.853471:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069017088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787758941.853496:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787758941.853505:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1090f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069017472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787758941.853548:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1090f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069017472:12345-0@lo:400:kworker.0 Request processed in 44us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758941.853555:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787758941.853574:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1874601069017600:0@lo:400:kworker.0 00000100:00100000:2.0:1787758941.853590:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfaed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1874601069017344:0@lo:400:kworker.0 00000100:00100000:1.0:1787758941.853593:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601069016960:0@lo:400:kworker.0 00010000:00080000:2.0:1787758941.853656:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccfcfae1c0 x1874601069017472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758941.853669:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069017472:0@lo:400:kworker.0 00010000:00010000:3.0:1787758942.237716:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787758942.689319:0:9025:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing yml_node 00010000:00010000:2.0:1787758943.260775:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787758943.884696:0:9217:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.104 00000100:00100000:3.0:1787758944.122589:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758944.122645:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758944.122655:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062700928 00000100:00100000:3.0:1787758944.122669:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758944.122673:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062700928 00000100:00100000:0.0:1787758944.122699:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062701056 00000100:00100000:0.0:1787758944.122707:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062701056 00000100:00100000:3.0:1787758944.122707:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758944.122744:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062701184 00000100:00100000:2.0:1787758944.122750:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062701184 00000100:00100000:3.0:1787758944.122758:0:7144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062701312 00000100:00100000:1.0:1787758944.122760:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 182 00000100:00100000:3.0:1787758944.122762:0:7144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062701312 00000100:00100000:0.0:1787758944.122765:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:1.0:1787758944.122774:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:2357:x1874601062700928:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1787758944.122780:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5882940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+6:2356:x1874601062701056:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1787758944.122809:0:7144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:2.0:1787758944.122815:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:3.0:1787758944.122819:0:7144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf58812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33089637-5953-4edf-8e89-39ecfabcd268+5:2356:x1874601062701312:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1787758944.122821:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5880b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33089637-5953-4edf-8e89-39ecfabcd268+5:2357:x1874601062701184:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1787758944.122855:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5882940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+6:2356:x1874601062701056:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 79us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758944.122855:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:2357:x1874601062700928:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 84us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758944.122858:0:7144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf58812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33089637-5953-4edf-8e89-39ecfabcd268+5:2356:x1874601062701312:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 39us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758944.122867:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5880b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33089637-5953-4edf-8e89-39ecfabcd268+5:2357:x1874601062701184:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 43us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758944.122872:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:3.0:1787758944.122877:0:7144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:1.0:1787758944.122878:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 182 00000100:00100000:2.0:1787758944.122885:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00080000:0.0:1787758944.122899:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787758944.122905:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787758944.122907:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787758944.284763:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787758944.648461:0:9314:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.104 00010000:00010000:3.0:1787758945.308710:0:8427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787758945.435119:0:9411:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.104 00000100:00100000:3.0:1787758945.436751:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5880f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1874601069017856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787758945.436811:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758945.436872:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069017856 00000100:00100000:0.0:1787758945.436880:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069017856 00000100:00080000:1.0:1787758945.436921:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787758945.436952:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787758945.436970:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf58803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874601069017856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787758945.437007:0:8593:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787758945.437078:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf58803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874601069017856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758945.437095:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787758945.437104:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf5880f00 x1874601069017856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758945.437125:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5880f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1874601069017856:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787758945.954892:0:9460:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity ============----- Wed Aug 26 11:42:26 EDT 2026 00010000:00010000:3.0:1787758946.332863:0:8426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758946.972756:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3293:1874601069017984:0@lo:400:kworker.0 00000100:00100000:2.0:1787758946.972782:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874601069018112:0@lo:400:kworker.0 00000100:00100000:3.0:1787758946.972788:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1874601069018368:0@lo:400:kworker.0 00000100:00100000:2.0:1787758946.972863:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758946.972863:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758946.972864:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758946.972929:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069018624:0@lo:400:kworker.0 00000100:00100000:2.0:1787758946.972953:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758946.972957:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3293:1874601069018496:0@lo:400:kworker.0 00000100:00100000:2.0:1787758946.972978:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787758946.972985:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1874601069018240:0@lo:400:kworker.0 00000100:00100000:1.0:1787758946.972996:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758946.973019:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069018112 00000100:00100000:2.0:1787758946.973026:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069018112 00000100:00100000:3.0:1787758946.973043:0:7144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069018368 00000100:00100000:3.0:1787758946.973049:0:7144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069018368 00000100:00100000:1.0:1787758946.973058:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069017984 00000100:00100000:1.0:1787758946.973063:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069017984 00000100:00100000:2.0:1787758946.973074:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069018496 00000100:00100000:2.0:1787758946.973078:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069018496 00000100:00100000:3.0:1787758946.973092:0:7144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069018624 00000100:00100000:3.0:1787758946.973097:0:7144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069018624 00000100:00100000:1.0:1787758946.973111:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787758946.973122:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787758946.973131:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1874601069018112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787758946.973137:0:7144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787758946.973143:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3293:x1874601069017984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787758946.973151:0:7144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5880780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1874601069018368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787758946.973160:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787758946.973170:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6969a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874601069018496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787758946.973191:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1874601069018112:12345-0@lo:400:kworker.0 Request processed in 62us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758946.973197:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787758946.973208:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3293:x1874601069017984:12345-0@lo:400:kworker.0 Request processed in 80us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758946.973217:0:7144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5880780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1874601069018368:12345-0@lo:400:kworker.0 Request processed in 69us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758946.973224:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787758946.973225:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6969a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874601069018496:12345-0@lo:400:kworker.0 Request processed in 52us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758946.973226:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787758946.973237:0:7144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787758946.973238:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787758946.973242:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069018624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787758946.973292:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069018624:12345-0@lo:400:kworker.0 Request processed in 55us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758946.973300:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3293:1874601069018496:0@lo:400:kworker.0 00000100:00100000:2.0:1787758946.973301:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787758946.973308:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf56da580 x1874601069018368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758946.973325:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3293:1874601069017984:0@lo:400:kworker.0 00000100:00100000:3.0:1787758946.973325:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1874601069018368:0@lo:400:kworker.0 00000100:00080000:2.0:1787758946.973339:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787758946.973344:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787758946.973370:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758946.973400:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069018240 00000100:00100000:3.0:1787758946.973403:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874601069018112:0@lo:400:kworker.0 00000100:00100000:2.0:1787758946.973404:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069018240 00010000:00080000:3.0:1787758946.973419:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf56d8f00 x1874601069018624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758946.973430:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069018624:0@lo:400:kworker.0 00000100:00100000:2.0:1787758946.973440:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787758946.973442:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787758946.973448:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5881680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1874601069018240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787758946.973480:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5881680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1874601069018240:12345-0@lo:400:kworker.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758946.973484:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787758946.973502:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1874601069018240:0@lo:400:kworker.0 00000100:00100000:3.0:1787758946.973698:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5883840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1874601069018752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787758946.973736:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758946.973783:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069018752 00000100:00100000:3.0:1787758946.973787:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069018752 00000100:00100000:3.0:1787758946.973825:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787758946.973835:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5883c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874601069018752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787758946.973867:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787758946.973906:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5883c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874601069018752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758946.973913:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787758946.973948:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf5883840 x1874601069018752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758946.973966:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5883840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1874601069018752:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787758947.356722:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758948.380698:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758949.242436:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758949.242470:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758949.242486:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062701440 00000100:00100000:3.0:1787758949.242498:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758949.242501:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062701440 00000100:00100000:0.0:1787758949.242515:0:7144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062701696 00000100:00100000:0.0:1787758949.242521:0:7144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062701696 00000100:00100000:1.0:1787758949.242573:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 184 00000100:00100000:0.0:1787758949.242576:0:7144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:3.0:1787758949.242576:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758949.242590:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:2357:x1874601062701440:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1787758949.242592:0:7144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5883840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33089637-5953-4edf-8e89-39ecfabcd268+5:2357:x1874601062701696:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1787758949.242606:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062701568 00000100:00100000:3.0:1787758949.242610:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062701568 00000100:00100000:3.0:1787758949.242691:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 19 00000100:00100000:3.0:1787758949.242697:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5882580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+6:2357:x1874601062701568:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1787758949.242712:0:7144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5883840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33089637-5953-4edf-8e89-39ecfabcd268+5:2357:x1874601062701696:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 121us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758949.242712:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:2357:x1874601062701440:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 124us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758949.242729:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 184 00000100:00100000:3.0:1787758949.242729:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5882580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+6:2357:x1874601062701568:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 31us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758949.242749:0:7144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:3.0:1787758949.242751:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 19 00000100:00100000:0.0:1787758949.242768:0:7144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062701824 00000100:00100000:0.0:1787758949.242771:0:7144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062701824 00000100:00080000:1.0:1787758949.242775:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787758949.242782:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787758949.242786:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787758949.242801:0:7144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:0.0:1787758949.242807:0:7144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5880f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33089637-5953-4edf-8e89-39ecfabcd268+5:2357:x1874601062701824:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1787758949.242831:0:7144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5880f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33089637-5953-4edf-8e89-39ecfabcd268+5:2357:x1874601062701824:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 26us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758949.242836:0:7144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 13 00010000:00010000:2.0:1787758949.405701:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758950.428790:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758950.557739:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787758950.557761:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069018880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787758950.557837:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758950.557903:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069018880 00000100:00100000:1.0:1787758950.557917:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069018880 00000100:00080000:0.0:1787758950.557975:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787758950.557997:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787758950.558011:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5ba52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069018880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787758950.558063:0:8593:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787758950.558144:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5ba52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069018880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758950.558159:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787758950.558198:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cce1093c00 x1874601069018880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758950.558219:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1093c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069018880:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787758951.226393:0:10187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34683240 <= 34618625) for LU-18938, skip 360 00010000:00010000:3.0:1787758951.452772:0:8427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787758951.725716:0:10236:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34683240 < 34486116) for LU-14927, skip 0f 00000100:00100000:1.0:1787758952.092888:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccc696a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069019008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787758952.092946:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf58821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601069019136:0@lo:400:kworker.0 00000100:00100000:1.0:1787758952.093003:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758952.093010:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758952.093081:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccffe5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1874601069019648:0@lo:400:kworker.0 00000100:00100000:1.0:1787758952.093085:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccffe5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069019520:0@lo:400:kworker.0 00000100:00100000:3.0:1787758952.093141:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758952.093143:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758952.093210:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787758952.093212:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787758952.093224:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5882d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874601069019264:0@lo:400:kworker.0 00000100:00100000:1.0:1787758952.093227:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccffe5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3293:1874601069019392:0@lo:400:kworker.0 00000100:00100000:3.0:1787758952.093277:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758952.093319:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccffe5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069019776:0@lo:400:kworker.0 00000100:00100000:1.0:1787758952.093320:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069019008 00000100:00100000:1.0:1787758952.093331:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069019008 00000100:00100000:3.0:1787758952.093360:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758952.093418:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069019136 00000100:00100000:3.0:1787758952.093424:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069019136 00000100:00100000:1.0:1787758952.093426:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787758952.093443:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc6969680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069019008:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787758952.093472:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787758952.093483:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3290:x1874601069019136:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1787758952.093501:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787758952.093519:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787758952.093549:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3290:x1874601069019136:12345-0@lo:400:kworker.0 Request processed in 66us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758952.093574:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787758952.093580:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc6969680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069019008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758952.093595:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787758952.093670:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069019648 00000100:00100000:3.0:1787758952.093676:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069019648 00000100:00100000:3.0:1787758952.093737:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069019264 00000100:00100000:3.0:1787758952.093741:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069019264 00000100:00100000:3.0:1787758952.093777:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787758952.093784:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787758952.093791:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccffe5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1874601069019648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787758952.093864:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccffe5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1874601069019648:12345-0@lo:400:kworker.0 Request processed in 75us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758952.093874:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787758952.093900:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069019520 00000100:00100000:1.0:1787758952.093908:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069019520 00000100:00100000:3.0:1787758952.093921:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787758952.093933:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccffe5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1874601069019264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758952.093966:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069019776 00000100:00100000:3.0:1787758952.093971:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccffe5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1874601069019264:12345-0@lo:400:kworker.0 Request processed in 43us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758952.093973:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069019776 00000100:00100000:3.0:1787758952.093982:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787758952.093992:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787758952.094016:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787758952.094028:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787758952.094032:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069019520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787758952.094040:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccffe5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069019776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787758952.094108:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccffe5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069019776:12345-0@lo:400:kworker.0 Request processed in 67us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758952.094109:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069019520:12345-0@lo:400:kworker.0 Request processed in 77us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758952.094121:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787758952.094128:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787758952.094205:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758952.094220:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5882d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874601069019264:0@lo:400:kworker.0 00010000:00080000:3.0:1787758952.094246:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccffe5e940 x1874601069019776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758952.094256:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccffe5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069019776:0@lo:400:kworker.0 00000100:00100000:3.0:1787758952.094273:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf58821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601069019136:0@lo:400:kworker.0 00000100:00100000:3.0:1787758952.094296:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccffe5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1874601069019648:0@lo:400:kworker.0 00010000:00080000:1.0:1787758952.094330:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccffe5c3c0 x1874601069019520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758952.094346:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccffe5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069019520:0@lo:400:kworker.0 00000100:00100000:3.0:1787758952.094349:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069019392 00000100:00100000:3.0:1787758952.094355:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069019392 00010000:00080000:1.0:1787758952.094377:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccc696a580 x1874601069019008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758952.094395:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787758952.094410:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874601069019392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758952.094414:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccc696a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069019008:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787758952.094429:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787758952.094459:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874601069019392:12345-0@lo:400:kworker.0 Request processed in 54us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758952.094467:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787758952.094474:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccffe5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3293:1874601069019392:0@lo:400:kworker.0 00000001:02000400:2.0:1787758952.226387:0:10284:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34683240 < 34681754) for LU-12550, skip 216 00010000:00010000:3.0:1787758952.476706:0:8426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787758952.715445:0:10332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 130b 130c 130d 130e 130f 130g 00000001:02000400:0.0:1787758953.217966:0:10381:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b 51c 51e 834 00010000:00010000:2.0:1787758953.500741:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787758953.685073:0:10429:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: start setup 11:42:34 (1787758954) === 00000100:00100000:3.0:1787758954.362461:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758954.362513:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758954.362524:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062702080 00000100:00100000:0.0:1787758954.362536:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062702080 00000100:00100000:3.0:1787758954.362549:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758954.362563:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062701952 00000100:00100000:1.0:1787758954.362570:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062701952 00000100:00100000:3.0:1787758954.362585:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758954.362638:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 186 00000100:00100000:1.0:1787758954.362651:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+10:2358:x1874601062701952:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1787758954.362656:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062702336 00000100:00100000:2.0:1787758954.362664:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062702336 00000100:00100000:0.0:1787758954.362702:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 23 00000100:00100000:0.0:1787758954.362718:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccffe5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+6:2359:x1874601062702080:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1787758954.362722:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062702208 00000100:00100000:1.0:1787758954.362725:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+10:2358:x1874601062701952:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 77us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758954.362730:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062702208 00000100:00100000:1.0:1787758954.362739:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 186 00000100:00100000:0.0:1787758954.362777:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccffe5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+6:2359:x1874601062702080:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 62us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758954.362781:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:0.0:1787758954.362797:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 23 00000100:00100000:1.0:1787758954.362798:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00100000:2.0:1787758954.362802:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccffe5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33089637-5953-4edf-8e89-39ecfabcd268+5:2359:x1874601062702336:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1787758954.362817:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccffe5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33089637-5953-4edf-8e89-39ecfabcd268+5:2358:x1874601062702208:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1787758954.362850:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccffe5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33089637-5953-4edf-8e89-39ecfabcd268+5:2359:x1874601062702336:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 53us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758954.362862:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:1.0:1787758954.362865:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccffe5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33089637-5953-4edf-8e89-39ecfabcd268+5:2358:x1874601062702208:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 52us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758954.362877:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00080000:3.0:1787758954.362889:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787758954.362897:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787758954.362902:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787758954.524688:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787758955.457422:0:10621:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1787758955.548746:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758955.676760:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1874601069019904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787758955.676839:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758955.676893:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069019904 00000100:00100000:2.0:1787758955.676903:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069019904 00000100:00080000:3.0:1787758955.676943:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787758955.676985:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787758955.677001:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5ba7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874601069019904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787758955.677053:0:8593:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787758955.677142:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5ba7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874601069019904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758955.677154:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787758955.677179:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf5ba5680 x1874601069019904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758955.677199:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1874601069019904:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787758956.572771:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758957.212810:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccfcfaed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069020032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787758957.212848:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1874601069020416:0@lo:400:kworker.0 00000100:00100000:2.0:1787758957.212882:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3293:1874601069020160:0@lo:400:kworker.0 00000100:00100000:3.0:1787758957.212935:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758957.212937:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758957.212949:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758957.213010:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069020544:0@lo:400:kworker.0 00000100:00100000:3.0:1787758957.213018:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1874601069020672:0@lo:400:kworker.0 00000100:00100000:2.0:1787758957.213041:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758957.213080:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758957.213099:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069020032 00000100:00100000:2.0:1787758957.213107:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069020544 00000100:00100000:1.0:1787758957.213110:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069020032 00000100:00100000:2.0:1787758957.213112:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069020544 00000100:00100000:3.0:1787758957.213118:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787758957.213127:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874601069020288:0@lo:400:kworker.0 00000100:00100000:3.0:1787758957.213164:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758957.213197:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787758957.213198:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787758957.213200:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069020800:0@lo:400:kworker.0 00000100:00100000:2.0:1787758957.213211:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069020544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758957.213219:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccffe5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069020032:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787758957.213232:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1787758957.213258:0:6672:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787758957.213274:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069020416 00000100:00100000:2.0:1787758957.213276:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069020544:12345-0@lo:400:kworker.0 Request processed in 69us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758957.213281:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069020416 00000100:00100000:2.0:1787758957.213286:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787758957.213293:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069020672 00000100:00100000:0.0:1787758957.213299:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069020672 00000100:00100000:2.0:1787758957.213308:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069020800 00000100:00100000:2.0:1787758957.213312:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069020800 00000100:00100000:1.0:1787758957.213324:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccffe5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3290:x1874601069020032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758957.213333:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069020288 00000100:00100000:3.0:1787758957.213338:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069020288 00000100:00100000:2.0:1787758957.213344:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787758957.213357:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787758957.213361:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787758957.213362:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccffe5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3290:x1874601069020800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787758957.213375:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874601069020416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787758957.213383:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787758957.213397:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccffe5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1874601069020672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787758957.213410:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccffe5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069020800:12345-0@lo:400:kworker.0 Request processed in 53us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758957.213418:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787758957.213464:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf56d9e00 x1874601069020544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758957.213478:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069020544:0@lo:400:kworker.0 00000100:00100000:0.0:1787758957.213488:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874601069020416:12345-0@lo:400:kworker.0 Request processed in 119us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758957.213497:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787758957.213520:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccffe5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1874601069020672:12345-0@lo:400:kworker.0 Request processed in 127us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758957.213531:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3292:1874601069020416:0@lo:400:kworker.0 00000100:00080000:2.0:1787758957.213536:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787758957.213538:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787758957.213552:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787758957.213556:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787758957.213575:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787758957.213588:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccffe5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1874601069020288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787758957.213596:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069020160 00000100:00100000:2.0:1787758957.213600:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069020160 00000100:00100000:2.0:1787758957.213662:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787758957.213667:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccffe5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1874601069020288:12345-0@lo:400:kworker.0 Request processed in 81us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758957.213675:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3293:x1874601069020160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787758957.213682:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787758957.213718:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3293:x1874601069020160:12345-0@lo:400:kworker.0 Request processed in 47us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758957.213727:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787758957.213727:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874601069020288:0@lo:400:kworker.0 00010000:00080000:3.0:1787758957.213746:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf56d83c0 x1874601069020800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787758957.213754:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069020800:0@lo:400:kworker.0 00000100:00100000:3.0:1787758957.213765:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3290:1874601069020672:0@lo:400:kworker.0 00010000:00080000:3.0:1787758957.213778:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccfcfaed00 x1874601069020032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758957.213790:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3293:1874601069020160:0@lo:400:kworker.0 00000100:00100000:3.0:1787758957.213794:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccfcfaed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069020032:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787758957.596697:0:8427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758958.620707:0:8426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787758959.482455:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758959.482531:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758959.482550:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062702464 00000100:00100000:1.0:1787758959.482570:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062702464 00000100:00100000:3.0:1787758959.482579:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062702592 00000100:00100000:3.0:1787758959.482587:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062702592 00000100:00080000:0.0:1787758959.482659:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787758959.482684:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 27 00000100:00100000:3.0:1787758959.482700:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5ba61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+6:2357:x1874601062702592:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1787758959.482711:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 188 00000100:00100000:1.0:1787758959.482731:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5453e3da-9a83-4395-adba-03dea8a5243b+10:2357:x1874601062702464:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1787758959.482782:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5ba61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+6:2357:x1874601062702592:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 91us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758959.482794:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 27 00000100:00100000:1.0:1787758959.482797:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5453e3da-9a83-4395-adba-03dea8a5243b+10:2357:x1874601062702464:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 68us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758959.482812:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 188 00000100:00100000:1.0:1787758959.485893:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758959.485950:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062702720 00000100:00100000:0.0:1787758959.485961:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062702720 00000100:00080000:1.0:1787758959.486017:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787758959.486052:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:0.0:1787758959.486063:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33089637-5953-4edf-8e89-39ecfabcd268+5:2355:x1874601062702720:12345-192.168.201.54@tcp:9:kworker.0 00000020:00000080:0.0:1787758959.486104:0:6670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa3b7f37aab2d253 00000100:00080000:0.0:1787758959.486120:0:6670:0:(import.c:65:import_set_state_nolock()) ffff99cbc557e800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787758959.486155:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787758959.486174:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787758959.486204:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758959.486287:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062702848 00000100:00100000:3.0:1787758959.486295:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062702848 00000100:00080000:1.0:1787758959.486348:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787758959.486363:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:3.0:1787758959.486380:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33089637-5953-4edf-8e89-39ecfabcd268+5:2355:x1874601062702848:12345-192.168.201.54@tcp:9:kworker.0 00000020:00000080:3.0:1787758959.486413:0:6669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa3b7f37aab2d25a 00000100:00080000:3.0:1787758959.486429:0:6669:0:(import.c:65:import_set_state_nolock()) ffff99ccfd10b800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787758959.486465:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787758959.486494:0:6669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787758959.486913:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33089637-5953-4edf-8e89-39ecfabcd268+2:2355:x1874601062702720:12345-192.168.201.54@tcp:9:kworker.0 Request processed in 851us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758959.486926:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:3.0:1787758959.487201:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33089637-5953-4edf-8e89-39ecfabcd268+2:2355:x1874601062702848:12345-192.168.201.54@tcp:9:kworker.0 Request processed in 827us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758959.487208:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 11 00010000:00010000:2.0:1787758959.644760:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758960.669743:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758960.796780:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1874601069020928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787758960.796855:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758960.796904:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069020928 00000100:00100000:2.0:1787758960.796920:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069020928 00000100:00080000:1.0:1787758960.796990:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787758960.797027:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787758960.797039:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfcfac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874601069020928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787758960.797085:0:8593:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787758960.797171:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfcfac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874601069020928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758960.797183:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787758960.797209:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf5ba6d00 x1874601069020928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758960.797228:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1874601069020928:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787758960.883601:0:11318:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787758961.692790:0:8427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787758962.021645:0:11465:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3cf6d630 20000000:00000080:1.0:1787758962.021659:0:11465:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99ccf5d63400 uarg=0000000000000000 20000000:01000000:1.0:1787758962.021687:0:11465:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787758962.021692:0:11465:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787758962.021696:0:11465:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787758962.022183:0:11466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787758962.022258:0:11465:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787758962.026381:0:11465:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787758962.026406:0:11465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ccf72b9e00/0xa3b7f37aab2d31e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.026427:0:11465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8762 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.026438:0:11465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccfd17aa00/0xa3b7f37aab2d2fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d2f4 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.026446:0:11465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccfd17bc00/0xa3b7f37aab2d309 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d302 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.026455:0:11465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ccc0030200/0xa3b7f37aab2d317 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d310 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.026463:0:11465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ccf72b9e00/0xa3b7f37aab2d31e lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.026510:0:11465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccc0030200/0xa3b7f37aab2d317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d310 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.026525:0:11465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ccc0030200/0xa3b7f37aab2d317 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d310 expref: 18 pid: 5816 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758962.026540:0:11465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccffe5cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11465:1874601069021056:0@lo:104: 00000100:00100000:3.0:1787758962.026600:0:11465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787758962.026688:0:11465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccfd17bc00/0xa3b7f37aab2d309 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d302 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758962.026697:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069021056 00010000:00010000:3.0:1787758962.026701:0:11465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ccfd17bc00/0xa3b7f37aab2d309 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d302 expref: 18 pid: 5815 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758962.026707:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069021056 00000100:00100000:3.0:1787758962.026717:0:11465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccffe5e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11465:1874601069021184:0@lo:104: 00000100:00100000:3.0:1787758962.026747:0:11465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758962.026763:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069021184 00000100:00100000:0.0:1787758962.026769:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069021184 00000100:00100000:2.0:1787758962.026784:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1787758962.026787:0:11465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ccfd17aa00/0xa3b7f37aab2d2fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa3b7f37aab2d2f4 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758962.026799:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccffe5c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+4:11465:x1874601069021056:12345-0@lo:104: 00010000:00010000:3.0:1787758962.026801:0:11465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ccfd17aa00/0xa3b7f37aab2d2fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa3b7f37aab2d2f4 expref: 18 pid: 5816 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758962.026813:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787758962.026820:0:8425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a000/0xa3b7f37aab2d310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d317 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758962.026825:0:11465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccffe5f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11465:1874601069021312:0@lo:104: 00000100:00100000:1.0:1787758962.026830:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccffe5da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+4:11465:x1874601069021184:12345-0@lo:104: 00010000:00010000:1.0:1787758962.026845:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d302 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d309 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758962.026857:0:11465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758962.026894:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069021312 00010000:00010000:3.0:1787758962.026896:0:11465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8762 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758962.026902:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069021312 00010000:00010000:3.0:1787758962.026916:0:11465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8762 expref: 9 pid: 5815 timeout: 212 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758962.026921:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787758962.026930:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccffe5da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:11465:x1874601069021184:12345-0@lo:104: Request processed in 106us (183us total) trans 0 rc 0/0 00010000:00010000:2.0:1787758962.026931:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787758962.026944:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787758962.026944:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccffe5c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:11465:x1874601069021056:12345-0@lo:104: Request processed in 147us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758962.026956:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787758962.026961:0:11465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccffe5c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11465:1874601069021440:192.168.201.54@tcp:104: 00000100:00100000:2.0:1787758962.026963:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787758962.026964:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccffe5e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+5:11465:x1874601069021312:12345-0@lo:104: 00010000:00010000:0.0:1787758962.026980:0:6684:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d2f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d2fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758962.026980:0:8426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787758962.027009:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787758962.027010:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d302 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d309 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758962.027017:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a000/0xa3b7f37aab2d310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d317 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758962.027020:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cccf888200 already unused, calling callback (ffffffffc1c61c20) 10000000:00010000:1.0:1787758962.027026:0:8426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d302 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d309 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758962.027037:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccfd17a000 already unused, calling callback (ffffffffc1c61c20) 00010000:00010000:1.0:1787758962.027039:0:8426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d302 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d309 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758962.027041:0:11465:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd00f180 going to sleep for 11 seconds 10000000:00010000:2.0:1787758962.027043:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a000/0xa3b7f37aab2d310 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d317 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787758962.027055:0:8426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d302 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d309 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758962.027058:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787758962.027063:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a000/0xa3b7f37aab2d310 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d317 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787758962.027066:0:8426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787758962.027070:0:11465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccffe5cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11465:1874601069021056:0@lo:104: 00000100:00100000:0.0:1787758962.027074:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccffe5e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+3:11465:x1874601069021312:12345-0@lo:104: Request processed in 115us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758962.027090:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 10000000:00010000:2.0:1787758962.027091:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a000/0xa3b7f37aab2d310 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d317 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758962.027094:0:11465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccffe5e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11465:1874601069021184:0@lo:104: 10000000:01000000:2.0:1787758962.027106:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787758962.027109:0:8426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d302 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d309 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758962.027115:0:11465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccffe5f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11465:1874601069021312:0@lo:104: 00010000:00010000:0.0:1787758962.027117:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787758962.027118:0:8426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787758962.027127:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d2f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa3b7f37aab2d2fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758962.027135:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a000/0xa3b7f37aab2d310 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d317 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758962.027139:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cccf888000 already unused, calling callback (ffffffffc1c61c20) 00010000:00010000:1.0:1787758962.027141:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d302 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d309 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758962.027146:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1787758962.027147:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d2f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa3b7f37aab2d2fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758962.027158:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce138b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3293:1874601069021568:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787758962.027165:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a000/0xa3b7f37aab2d310 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d317 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758962.027167:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99cccf888200/0xa3b7f37aab2d302 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d309 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758962.027177:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d2f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa3b7f37aab2d2fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758962.027190:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99ccfd17a000/0xa3b7f37aab2d310 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d317 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758962.027199:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787758962.027200:0:8426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758962.027202:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758962.027204:0:8426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758962.027207:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758962.027209:0:8426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758962.027211:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1787758962.027218:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d2f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa3b7f37aab2d2fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758962.027226:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601069021696:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1787758962.027227:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787758962.027254:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d2f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d2fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758962.027263:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787758962.027269:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758962.027272:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069021568 00000100:00100000:3.0:1787758962.027277:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069021568 00010000:00010000:0.0:1787758962.027285:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d2f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d2fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758962.027296:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d2f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa3b7f37aab2d2fb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758962.027299:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1787758962.027303:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccfd17bc00/0xa3b7f37aab2d309 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d302 expref: 19 pid: 5815 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758962.027310:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601069021824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787758962.027321:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758962.027326:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758962.027331:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787758962.027343:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758962.027344:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069021696 00000100:00100000:3.0:1787758962.027349:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069021696 00010000:00010000:3.0:1787758962.027364:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccc0030200/0xa3b7f37aab2d317 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d310 expref: 20 pid: 5816 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758962.027370:0:7615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069021824 00000100:00100000:0.0:1787758962.027377:0:7615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069021824 00000100:00100000:2.0:1787758962.027388:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787758962.027398:0:7615:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ccfd17aa00/0xa3b7f37aab2d2fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d2f4 expref: 21 pid: 5816 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758962.027398:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf58821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+21:3293:x1874601069021568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787758962.027412:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787758962.027418:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccfd17bc00/0xa3b7f37aab2d309 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d302 expref: 21 pid: 5815 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758962.027429:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccfd17bc00/0xa3b7f37aab2d309 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d302 expref: 21 pid: 5815 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758962.027442:0:7615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1787758962.027448:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccfd17bc00/0xa3b7f37aab2d309 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d302 expref: 21 pid: 5815 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758962.027453:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787758962.027457:0:7615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc9720850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+21:3290:x1874601069021696:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787758962.027469:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+20:3290:x1874601069021824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787758962.027473:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787758962.027474:0:7615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787758962.027483:0:7615:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccc0030200/0xa3b7f37aab2d317 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d310 expref: 20 pid: 5816 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.027483:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787758962.027494:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ccfd17aa00/0xa3b7f37aab2d2fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa3b7f37aab2d2f4 expref: 20 pid: 5816 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758962.027503:0:7615:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccc0030200/0xa3b7f37aab2d317 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d310 expref: 20 pid: 5816 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758962.027510:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf58821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+20:3293:x1874601069021568:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758962.027526:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787758962.027532:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce138b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3293:1874601069021568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787758962.027536:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ccfd17aa00/0xa3b7f37aab2d2fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa3b7f37aab2d2f4 expref: 20 pid: 5816 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758962.027556:0:7615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccc0030200/0xa3b7f37aab2d317 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d310 expref: 19 pid: 5816 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.027561:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccfd17aa00/0xa3b7f37aab2d2fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa3b7f37aab2d2f4 expref: 19 pid: 5816 timeout: 262 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758962.027571:0:7615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787758962.027587:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787758962.027645:0:7615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc9720850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:3290:x1874601069021696:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758962.027655:0:7615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787758962.027660:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:3290:x1874601069021824:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758962.027664:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601069021824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787758962.027678:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787758962.027683:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3290:1874601069021696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787758962.028324:0:11465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccffe5c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11465:1874601069021440:192.168.201.54@tcp:104: 00010000:00010000:3.0:1787758962.028404:0:11465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ccf72b9e00/0xa3b7f37aab2d31e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758962.028455:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758962.028532:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062702976 00000100:00100000:3.0:1787758962.028538:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062702976 00010000:00010000:3.0:1787758962.028557:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8762 expref: 10 pid: 5815 timeout: 212 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758962.028584:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 27 00000100:00100000:3.0:1787758962.028592:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce138b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5453e3da-9a83-4395-adba-03dea8a5243b+10:2358:x1874601062702976:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787758962.028602:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787758962.028607:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8762 expref: 10 pid: 5815 timeout: 212 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.028644:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8762 expref: 10 pid: 5815 timeout: 212 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.028660:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d2ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8762 expref: 10 pid: 5815 timeout: 212 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.028675:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ccf72b9e00/0xa3b7f37aab2d31e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.028696:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf72b9e00/0xa3b7f37aab2d31e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.028709:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccf72b9e00/0xa3b7f37aab2d31e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.028718:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ccf72b9e00/0xa3b7f37aab2d31e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.028726:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ccf72b9e00/0xa3b7f37aab2d31e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.028733:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ccf72b9e00/0xa3b7f37aab2d31e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.028739:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b9e00 already unused, calling callback (ffffffffc1666530) 00010000:00010000:3.0:1787758962.028744:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ccf72b9e00/0xa3b7f37aab2d31e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.028753:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ccf72b9e00/0xa3b7f37aab2d31e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.028776:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ccf72b9e00/0xa3b7f37aab2d31e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758962.028785:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787758962.028803:0:11465:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ccf72b9e00/0xa3b7f37aab2d31e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758962.028812:0:11465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ccf72b9e00/0xa3b7f37aab2d31e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758962.028817:0:11465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ccf72b9e00/0xa3b7f37aab2d31e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758962.028827:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce138b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5453e3da-9a83-4395-adba-03dea8a5243b+9:2358:x1874601062702976:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 232us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758962.028837:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 27 00000100:00100000:1.0:1787758962.332830:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1874601069022208:0@lo:400:kworker.0 00000100:00100000:3.0:1787758962.332831:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99cce1388b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1874601069021952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787758962.332880:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874601069022080:0@lo:400:kworker.0 00000100:00100000:0.0:1787758962.332911:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1874601069022336:0@lo:400:kworker.0 00000100:00100000:1.0:1787758962.332920:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758962.332922:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758962.332962:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758962.333013:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758962.333020:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1874601069022464:0@lo:400:kworker.0 00000100:00100000:2.0:1787758962.333042:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069022592:0@lo:400:kworker.0 00000100:00100000:1.0:1787758962.333049:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069021952 00000100:00100000:1.0:1787758962.333057:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069021952 00000100:00100000:3.0:1787758962.333078:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758962.333092:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758962.333112:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069022208 00000100:00100000:0.0:1787758962.333120:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069022208 00000100:00100000:1.0:1787758962.333135:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787758962.333150:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069022336 00000100:00100000:1.0:1787758962.333153:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5882d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1874601069021952:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787758962.333159:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069022336 00000100:00100000:2.0:1787758962.333190:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069022080 00002000:00000024:1.0:1787758962.333193:0:6673:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787758962.333195:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069022464 00000100:00100000:2.0:1787758962.333199:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069022080 00000100:00100000:0.0:1787758962.333203:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069022464 00000100:00100000:3.0:1787758962.333219:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069022592 00000100:00100000:3.0:1787758962.333226:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069022592 00000100:00100000:1.0:1787758962.333259:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5882d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1874601069021952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758962.333266:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787758962.333270:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787758962.333275:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787758962.333284:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787758962.333285:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce138ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1874601069022208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787758962.333296:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5ba6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1874601069022336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787758962.333304:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874601069022464:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787758962.333305:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787758962.333313:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787758962.333316:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787758962.333332:0:7144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787758962.333347:0:7144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069022592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787758962.333394:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce138ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1874601069022208:12345-0@lo:400:kworker.0 Request processed in 113us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758962.333413:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5ba6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1874601069022336:12345-0@lo:400:kworker.0 Request processed in 117us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758962.333414:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787758962.333417:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874601069022464:12345-0@lo:400:kworker.0 Request processed in 114us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758962.333427:0:7144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874601069022592:12345-0@lo:400:kworker.0 Request processed in 80us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758962.333432:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787758962.333442:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787758962.333447:0:7144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787758962.333460:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787758962.333473:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874601069022080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758962.333505:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3290:1874601069022208:0@lo:400:kworker.0 00010000:00080000:0.0:1787758962.333535:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf5ba6580 x1874601069022592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758962.333544:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874601069022080:12345-0@lo:400:kworker.0 Request processed in 74us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758962.333561:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787758962.333571:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf5ba4b40 x1874601069022336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758962.333590:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069022592:0@lo:400:kworker.0 00000100:00100000:1.0:1787758962.333590:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1874601069022336:0@lo:400:kworker.0 00000100:00100000:0.0:1787758962.333673:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874601069022080:0@lo:400:kworker.0 00000100:00100000:2.0:1787758962.333680:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3292:1874601069022464:0@lo:400:kworker.0 00010000:00080000:2.0:1787758962.333715:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99cce1388b40 x1874601069021952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758962.333741:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99cce1388b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1874601069021952:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787758962.341457:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 33089637-5953-4edf-8e89-39ecfabcd268 00000020:00000080:1.0:1787758962.341464:0:6696:0:(genops.c:885:class_export_put()) final put ffff99cbc557d800/33089637-5953-4edf-8e89-39ecfabcd268 00000020:00000080:0.0:1787758962.341498:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99cbc557d800/33089637-5953-4edf-8e89-39ecfabcd268 for lustre-OST0000 00000020:00000080:0.0:1787758962.341559:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99cbc557e800 for lustre-OST0000 00010000:00010000:2.0:1787758962.717721:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787758963.244436:0:11662:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787758963.740739:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787758963.879298:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 33089637-5953-4edf-8e89-39ecfabcd268 00000020:00000080:3.0:1787758963.879306:0:7625:0:(genops.c:885:class_export_put()) final put ffff99ccfd10d800/33089637-5953-4edf-8e89-39ecfabcd268 00000020:00000080:1.0:1787758963.879345:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99ccfd10d800/33089637-5953-4edf-8e89-39ecfabcd268 for lustre-OST0001 00000020:00000080:1.0:1787758963.879398:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99ccfd10b800 for lustre-OST0001 00000100:00100000:1.0:1787758963.899810:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758963.899857:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062703104 00000100:00100000:3.0:1787758963.899866:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062703104 00000100:00100000:3.0:1787758963.899914:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 189 00000100:00100000:3.0:1787758963.899924:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+9:5588:x1874601062703104:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787758963.899938:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758963.899977:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccf72b9800/0xa3b7f37aab2d325 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8769 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758963.900007:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccf72b9800/0xa3b7f37aab2d325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8769 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758963.900018:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccf72b9800/0xa3b7f37aab2d325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8769 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758963.900035:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf72b9800, rc 0) 00000100:00100000:3.0:1787758963.900083:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:5588:x1874601062703104:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 Request processed in 162us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758963.900089:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 189 00000100:00100000:2.0:1787758963.901570:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758963.901611:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062703232 00000100:00100000:0.0:1787758963.901644:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062703232 00000100:00100000:0.0:1787758963.901678:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 190 00000100:00100000:0.0:1787758963.901686:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5453e3da-9a83-4395-adba-03dea8a5243b+10:5588:x1874601062703232:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787758963.901907:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5453e3da-9a83-4395-adba-03dea8a5243b+10:5588:x1874601062703232:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 Request processed in 222us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758963.901915:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 190 00000100:00100000:1.0:1787758963.903156:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758963.903184:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062703360 00000100:00100000:3.0:1787758963.903189:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062703360 00000100:00100000:3.0:1787758963.903220:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 191 00000100:00100000:3.0:1787758963.903229:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:5588:x1874601062703360:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787758963.903378:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:5588:x1874601062703360:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 Request processed in 151us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758963.903384:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 191 10000000:01000000:2.0:1787758963.933671:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787758963.933678:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ccffe2e000 from 7 10000000:01000000:2.0:1787758963.933684:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787758963.933728:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cccf889e00/0xa3b7f37aab2d32c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758963.933740:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99cccf889e00/0xa3b7f37aab2d32c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758963.933753:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99cccf889e00/0xa3b7f37aab2d32c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758963.933785:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069022720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787758963.933850:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758963.933887:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069022720 00000100:00100000:0.0:1787758963.933895:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069022720 00000100:00100000:2.0:1787758963.933899:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccf5c74600 going to sleep for 11 seconds 00000100:00100000:0.0:1787758963.933940:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787758963.933948:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+16:5818:x1874601069022720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787758963.933971:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758963.933982:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d333 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d32c expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758963.934005:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d32c expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758963.934014:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccd96fc600/0xa3b7f37aab2d333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d32c expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758963.934021:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccd96fc600, rc 0) 00000100:00100000:0.0:1787758963.934059:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069022720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758963.934066:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787758963.934094:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069022720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787758963.934111:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99cccf889e00/0xa3b7f37aab2d32c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d333 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758963.934122:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99cccf889e00/0xa3b7f37aab2d32c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d333 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758963.934176:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069022848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787758963.934204:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758963.934225:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccf5c74600 going to sleep for 11 seconds 00000100:00100000:3.0:1787758963.934255:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069022848 00000100:00100000:3.0:1787758963.934260:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069022848 00000100:00100000:3.0:1787758963.934287:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787758963.934313:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069022848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787758963.934554:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7469c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069022848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758963.934560:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787758963.934579:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069022848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787758963.934687:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069022976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787758963.934737:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758963.934790:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccf5c74600 going to sleep for 11 seconds 00000100:00100000:3.0:1787758963.934797:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069022976 00000100:00100000:3.0:1787758963.934804:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069022976 00000100:00100000:3.0:1787758963.934846:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787758963.934860:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069022976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787758963.935130:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7469450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069022976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 273us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758963.935152:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787758963.935158:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069022976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787758963.936109:0:11727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787758963.936187:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787758963.936206:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787758963.936211:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cccf889e00/0xa3b7f37aab2d32c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d333 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758963.936219:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99cccf889e00/0xa3b7f37aab2d32c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d333 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787758963.936226:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787758963.936227:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ccc782b000 from 7 10000000:01000000:3.0:1787758963.936229:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787758963.936242:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8e00/0xa3b7f37aab2d33a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758963.936247:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8e00/0xa3b7f37aab2d33a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758963.936252:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8e00/0xa3b7f37aab2d33a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758963.936262:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf58821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069023104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787758963.936283:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758963.936304:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd00f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787758963.936320:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069023104 00000100:00100000:2.0:1787758963.936326:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069023104 00000100:00100000:2.0:1787758963.936357:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787758963.936366:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+17:5818:x1874601069023104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787758963.936375:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758963.936390:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d341 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d33a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758963.936405:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d341 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d33a expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758963.936415:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99cccf889000/0xa3b7f37aab2d341 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d33a expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758963.936423:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99cccf889000, rc 0) 00000100:00100000:2.0:1787758963.936457:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069023104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758963.936465:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787758963.936483:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf58821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069023104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787758963.936494:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8e00/0xa3b7f37aab2d33a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d341 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758963.936500:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8e00/0xa3b7f37aab2d33a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d341 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758963.936538:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf58821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069023232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787758963.936560:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758963.936584:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd00f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787758963.936606:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069023232 00000100:00100000:0.0:1787758963.936611:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069023232 00000100:00100000:0.0:1787758963.936656:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787758963.936669:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069023232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787758963.936813:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069023232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758963.936819:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787758963.936840:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf58821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069023232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787758963.936861:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf58821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069023360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787758963.936889:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758963.936908:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd00f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787758963.936922:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069023360 00000100:00100000:2.0:1787758963.936928:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069023360 00000100:00100000:2.0:1787758963.936967:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787758963.936976:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069023360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787758963.937108:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069023360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758963.937118:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787758963.937134:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf58821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069023360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787758963.937739:0:11728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787758963.937789:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787758963.937807:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787758963.937813:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8e00/0xa3b7f37aab2d33a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d341 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758963.937822:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99ccf72b8e00/0xa3b7f37aab2d33a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d341 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787758963.937831:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787758963.937839:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99ccd06d3800 from 7 10000000:01000000:2.0:1787758963.937842:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787758963.937856:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d348 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758963.937865:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d348 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758963.937873:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d348 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758963.937886:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069023488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787758963.937914:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758963.937941:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccf5c74d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787758963.937944:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069023488 00000100:00100000:0.0:1787758963.937959:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069023488 00000100:00100000:0.0:1787758963.937985:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787758963.937990:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+18:5818:x1874601069023488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787758963.937997:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758963.938004:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ccd96fd200/0xa3b7f37aab2d34f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa3b7f37aab2d348 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758963.938017:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ccd96fd200/0xa3b7f37aab2d34f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa3b7f37aab2d348 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758963.938024:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ccd96fd200/0xa3b7f37aab2d34f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa3b7f37aab2d348 expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758963.938029:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccd96fd200, rc 0) 00000100:00100000:0.0:1787758963.938057:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069023488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 67us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758963.938062:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787758963.938082:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069023488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787758963.938095:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d348 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d34f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758963.938104:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d348 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa3b7f37aab2d34f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758963.938143:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069023616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787758963.938176:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758963.938196:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccf5c74d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787758963.938200:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069023616 00000100:00100000:3.0:1787758963.938206:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069023616 00000100:00100000:3.0:1787758963.938230:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787758963.938237:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069023616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787758963.938362:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069023616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758963.938369:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787758963.938387:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069023616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787758963.938416:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069023744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787758963.938454:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758963.938474:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccf5c74d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787758963.938492:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069023744 00000100:00100000:0.0:1787758963.938497:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069023744 00000100:00100000:0.0:1787758963.938527:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787758963.938538:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc7468850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069023744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787758963.938734:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc7468850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:5818:x1874601069023744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758963.938746:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:5818:1874601069023744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787758963.938760:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000040:00080000:2.0:1787758963.939671:0:11729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787758963.939713:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787758963.939736:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787758963.939742:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d348 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d34f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758963.939750:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff99cccf888000/0xa3b7f37aab2d348 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa3b7f37aab2d34f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:2.0:1787758964.414086:0:11766:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: finish setup 11:42:44 (1787758964) === 00000100:00100000:1.0:1787758964.441841:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758964.441975:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062703488 00000100:00100000:3.0:1787758964.441994:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062703488 00000100:00080000:1.0:1787758964.442040:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787758964.442067:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:3.0:1787758964.442081:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1389e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+6:7613:x1874601062703488:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:3.0:1787758964.442101:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758964.442124:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9000/0xa3b7f37aab2d356 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8770 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442191:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9a00/0xa3b7f37aab2d35d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442206:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9a00/0xa3b7f37aab2d35d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442220:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9a00/0xa3b7f37aab2d35d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442237:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d364 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442246:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d364 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442255:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d364 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442595:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9a00/0xa3b7f37aab2d35d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442606:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9a00/0xa3b7f37aab2d35d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442648:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9a00/0xa3b7f37aab2d35d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442663:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b9a00 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758964.442668:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9a00/0xa3b7f37aab2d35d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442677:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9a00/0xa3b7f37aab2d35d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442691:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc7a86800) 00010000:00010000:3.0:1787758964.442695:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758964.442701:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9a00/0xa3b7f37aab2d35d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442709:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9a00/0xa3b7f37aab2d35d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442725:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d364 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442733:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d364 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442740:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d364 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442747:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b9400 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758964.442751:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d364 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442758:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d364 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442778:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54ef8a6e (ffff99cce1b3ff00) 00010000:00010000:3.0:1787758964.442782:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758964.442786:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d364 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442793:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d364 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442838:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9000/0xa3b7f37aab2d356 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8770 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442850:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc7a86800) 00010000:00010000:3.0:1787758964.442854:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787758964.442858:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9000/0xa3b7f37aab2d356 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8770 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.442872:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf72b9000, rc 0) 00000100:00100000:3.0:1787758964.442931:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1389e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+6:7613:x1874601062703488:12345-192.168.201.54@tcp:101:bash.0 Request processed in 853us (1095us total) trans 0 rc 301/301 00000100:00100000:3.0:1787758964.442956:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:1.0:1787758964.443924:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758964.443975:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062703616 00000100:00100000:3.0:1787758964.443981:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062703616 00000100:00100000:3.0:1787758964.444016:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:3.0:1787758964.444026:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1388b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+6:7613:x1874601062703616:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:3.0:1787758964.444037:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758964.444049:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d36b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8777 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.444100:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d372 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.444112:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d372 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.444122:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d372 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.445448:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d379 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.445467:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d379 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.445477:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d379 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.445845:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d372 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.445853:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d372 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.445860:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d372 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.445865:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b8600 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758964.445870:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d372 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.445886:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d372 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.445902:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc7a86800) 00010000:00010000:3.0:1787758964.445905:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758964.445910:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d372 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.445915:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d372 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.445927:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d379 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.445932:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d379 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.445937:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d379 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.445958:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b9200 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758964.445962:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d379 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.445968:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d379 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.445974:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77bdd2c7 (ffff99cce1b3f300) 00010000:00010000:3.0:1787758964.445976:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758964.445979:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d379 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.445993:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d379 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.446044:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d36b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8777 expref: 7 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.446055:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc7a86800) 00010000:00010000:3.0:1787758964.446057:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787758964.446062:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d36b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8777 expref: 7 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.446072:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf72b8800, rc 0) 00000100:00100000:3.0:1787758964.446180:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1388b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+6:7613:x1874601062703616:12345-192.168.201.54@tcp:101:bash.0 Request processed in 2152us (2254us total) trans 0 rc 301/301 00000100:00100000:3.0:1787758964.446193:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:1.0:1787758964.448339:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758964.448394:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062703744 00000100:00100000:3.0:1787758964.448405:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062703744 00000100:00100000:3.0:1787758964.448448:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 1 00000100:00100000:3.0:1787758964.448457:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99cce1388780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33089637-5953-4edf-8e89-39ecfabcd268+6:7613:x1874601062703744:12345-192.168.201.54@tcp:37:bash.0 00000100:00100000:3.0:1787758964.450909:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99cce1388780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33089637-5953-4edf-8e89-39ecfabcd268+6:7613:x1874601062703744:12345-192.168.201.54@tcp:37:bash.0 Request processed in 2450us (2574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758964.450917:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 1 00000100:00100000:1.0:1787758964.456709:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758964.456748:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062703872 00000100:00100000:0.0:1787758964.456756:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062703872 00000100:00100000:0.0:1787758964.456804:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:0.0:1787758964.456813:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+6:10411:x1874601062703872:12345-192.168.201.54@tcp:101:rm.0 00010000:00010000:0.0:1787758964.456830:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758964.456849:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d380 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea877e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.456904:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d387 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.456916:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d387 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.456926:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d387 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458064:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d38e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458077:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d38e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458086:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d38e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458366:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d387 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458373:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d387 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458385:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d387 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458390:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccd96fd400 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758964.458393:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d387 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458399:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d387 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458412:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc7a86800) 00010000:00010000:0.0:1787758964.458416:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787758964.458421:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d387 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458428:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d387 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458444:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d38e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458451:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d38e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458457:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d38e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458461:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccd96fce00 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758964.458463:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d38e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458477:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d38e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458484:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3d64192e (ffff99ccc705f500) 00010000:00010000:0.0:1787758964.458486:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787758964.458488:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d38e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458493:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d38e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458525:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d380 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea877e expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458533:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc7a86800) 00010000:00010000:0.0:1787758964.458535:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787758964.458538:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d380 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea877e expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.458546:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccd96fd800, rc 0) 00000100:00100000:0.0:1787758964.458599:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+6:10411:x1874601062703872:12345-192.168.201.54@tcp:101:rm.0 Request processed in 1788us (1897us total) trans 0 rc 301/301 00000100:00100000:0.0:1787758964.458605:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:1.0:1787758964.487522:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758964.487577:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062704000 00000100:00100000:2.0:1787758964.487587:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062704000 00000100:00100000:2.0:1787758964.487866:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:2.0:1787758964.487876:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:33089637-5953-4edf-8e89-39ecfabcd268+6:10417:x1874601062704000:12345-192.168.201.54@tcp:700:mkdir.0 00000100:00100000:2.0:1787758964.487961:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:33089637-5953-4edf-8e89-39ecfabcd268+6:10417:x1874601062704000:12345-192.168.201.54@tcp:700:mkdir.0 Request processed in 86us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758964.487967:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:1.0:1787758964.488824:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758964.488876:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062704256 00000100:00100000:2.0:1787758964.488881:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062704256 00000100:00100000:2.0:1787758964.488911:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:2.0:1787758964.488918:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+6:10417:x1874601062704256:12345-192.168.201.54@tcp:36:mkdir.0 00010000:00010000:2.0:1787758964.488970:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787758964.488998:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8a00/0xa3b7f37aab2d268 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea874d expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.489011:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc7a86800) 00010000:00010000:2.0:1787758964.489022:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787758964.489293:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf889800/0xa3b7f37aab2d395 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.489304:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf889800/0xa3b7f37aab2d395 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.489313:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf889800/0xa3b7f37aab2d395 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.490645:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d39c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.490659:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d39c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.490670:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d39c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787758964.492137:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787758964.492149:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf889800/0xa3b7f37aab2d395 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.492158:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf889800/0xa3b7f37aab2d395 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.492166:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf889800/0xa3b7f37aab2d395 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.492173:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cccf889800 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:2.0:1787758964.492179:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf889800/0xa3b7f37aab2d395 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.492187:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf889800/0xa3b7f37aab2d395 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.492199:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd83ee700) 00010000:00010000:2.0:1787758964.492203:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787758964.492208:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf889800/0xa3b7f37aab2d395 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.492227:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf889800/0xa3b7f37aab2d395 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787758964.492246:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000feb1b233 reply state 00000000a2ace069 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d39c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758964.492256:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787758964.492359:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+7:10417:x1874601062704256:12345-192.168.201.54@tcp:36:mkdir.0 Request processed in 3437us (3531us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787758964.492369:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 13 00010000:00010000:0.0:1787758964.493159:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d39c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.493168:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d39c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.493181:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d39c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.493185:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cccf888200 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758964.493188:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d39c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.493192:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d39c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.493199:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99ccd83ee100) 00010000:00010000:0.0:1787758964.493201:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787758964.493204:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d39c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.493208:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d39c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758964.496697:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758964.496785:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062704384 00000100:00100000:3.0:1787758964.496799:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062704384 00000100:00100000:3.0:1787758964.496868:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00100000:3.0:1787758964.496881:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+6:10418:x1874601062704384:12345-192.168.201.54@tcp:101:chmod.0 00010000:00010000:3.0:1787758964.496923:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758964.496964:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d3a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8785 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.497047:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d3aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.497060:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d3aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.497070:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d3aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787758964.497126:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787758964.497129:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787758964.497171:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d3aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.497194:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d3a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8785 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.497209:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d3aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8785 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.497216:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cce1b3f300) 00010000:00010000:3.0:1787758964.497219:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787758964.497222:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf72b9200, rc 0) 00000100:00100000:3.0:1787758964.497278:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+7:10418:x1874601062704384:12345-192.168.201.54@tcp:101:chmod.0 Request processed in 402us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758964.497284:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00100000:1.0:1787758964.498183:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758964.498217:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062704640 00000100:00100000:3.0:1787758964.498222:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062704640 00000100:00100000:3.0:1787758964.498250:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:3.0:1787758964.498256:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+7:10418:x1874601062704640:12345-192.168.201.54@tcp:36:chmod.0 00010000:00010000:3.0:1787758964.498286:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787758964.498299:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d3aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8785 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.498310:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cce1b3f300) 00010000:00010000:3.0:1787758964.498317:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787758964.498329:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3b1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.498335:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.498341:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787758964.498702:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000553f97aa reply state 0000000030d42f0b transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758964.498711:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787758964.498721:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787758964.498779:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+8:10418:x1874601062704640:12345-192.168.201.54@tcp:36:chmod.0 Request processed in 523us (597us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787758964.498784:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 15 00010000:00010000:3.0:1787758964.499339:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.499348:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3b1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.499360:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3b1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.499365:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b8600 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758964.499369:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3b1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.499375:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3b1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.499382:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99cce1b3ff00) 00010000:00010000:3.0:1787758964.499384:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787758964.499387:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3b1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.499392:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3b1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758964.508710:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758964.508782:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062704768 00000100:00100000:0.0:1787758964.508791:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062704768 00000100:00100000:0.0:1787758964.508830:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:0.0:1787758964.508838:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+7:10419:x1874601062704768:12345-192.168.201.54@tcp:101:chown.0 00010000:00010000:0.0:1787758964.508857:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758964.508871:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d3b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea878c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.508919:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d3bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.508962:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d3bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.508971:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d3bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787758964.509013:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787758964.509015:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787758964.509043:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d3bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.509062:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d3b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea878c expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.509075:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d3bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea878c expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.509081:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f500) 00010000:00010000:0.0:1787758964.509083:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787758964.509086:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccd96fd400, rc 0) 00000100:00100000:0.0:1787758964.509136:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+8:10419:x1874601062704768:12345-192.168.201.54@tcp:101:chown.0 Request processed in 297us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758964.509143:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:1.0:1787758964.510021:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758964.510109:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062704896 00000100:00100000:2.0:1787758964.510122:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062704896 00000100:00100000:2.0:1787758964.510185:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00100000:2.0:1787758964.510197:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+8:10419:x1874601062704896:12345-192.168.201.54@tcp:101:chown.0 00010000:00010000:2.0:1787758964.510217:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758964.510235:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf889800/0xa3b7f37aab2d3c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8793 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510292:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888c00/0xa3b7f37aab2d3cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510303:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888c00/0xa3b7f37aab2d3cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510312:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888c00/0xa3b7f37aab2d3cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510323:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d3d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510345:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510359:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510462:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4e00/0xa3b7f37aab2d3db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510469:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4e00/0xa3b7f37aab2d3db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510474:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4e00/0xa3b7f37aab2d3db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787758964.510506:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787758964.510509:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787758964.510527:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4e00/0xa3b7f37aab2d3db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510536:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888c00/0xa3b7f37aab2d3cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510540:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888c00/0xa3b7f37aab2d3cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510546:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888c00/0xa3b7f37aab2d3cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510550:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cccf888c00 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:2.0:1787758964.510553:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888c00/0xa3b7f37aab2d3cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510563:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888c00/0xa3b7f37aab2d3cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510572:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f500) 00010000:00010000:2.0:1787758964.510574:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787758964.510578:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888c00/0xa3b7f37aab2d3cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510583:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888c00/0xa3b7f37aab2d3cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510594:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510598:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d3d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510602:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510606:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99cccf888200 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:2.0:1787758964.510607:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510611:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d3d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510651:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99ccd83ee700) 00010000:00010000:2.0:1787758964.510654:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787758964.510658:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d3d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510670:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf888200/0xa3b7f37aab2d3d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510697:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99cccf889800/0xa3b7f37aab2d3c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8793 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510707:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4e00/0xa3b7f37aab2d3db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8793 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.510712:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99ccd83ee200) 00010000:00010000:2.0:1787758964.510714:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787758964.510715:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc79d4e00, rc 0) 00000100:00100000:2.0:1787758964.510774:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+9:10419:x1874601062704896:12345-192.168.201.54@tcp:101:chown.0 Request processed in 581us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758964.510779:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00100000:1.0:1787758964.511793:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758964.511830:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062705152 00000100:00100000:3.0:1787758964.511837:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062705152 00000100:00100000:3.0:1787758964.511873:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 18 00000100:00100000:3.0:1787758964.511883:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+9:10419:x1874601062705152:12345-192.168.201.54@tcp:36:chown.0 00010000:00010000:3.0:1787758964.511919:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787758964.511937:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4e00/0xa3b7f37aab2d3db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8793 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.511970:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99ccd83ee200) 00010000:00010000:3.0:1787758964.511979:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787758964.511997:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.512011:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.512019:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787758964.522480:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:2.0:1787758964.522505:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1787758964.522596:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef47f3b5 reply state 00000000e2701439 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758964.522639:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787758964.522755:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1787758964.522851:0:5823:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787758964.522874:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+7:10419:x1874601062705152:12345-192.168.201.54@tcp:36:chown.0 Request processed in 10989us (11079us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787758964.522884:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 18 00010000:00010000:3.0:1787758964.522889:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.522899:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.522906:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.522911:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b8600 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758964.522915:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.522922:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.522934:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cce1b3ff00) 00010000:00010000:3.0:1787758964.522937:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787758964.522957:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.522963:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758964.528898:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758964.528964:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062705280 00000100:00100000:3.0:1787758964.528978:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062705280 00000100:00100000:3.0:1787758964.529018:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 19 00000100:00100000:3.0:1787758964.529025:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+6:10420:x1874601062705280:12345-192.168.201.54@tcp:101:touch.500 00010000:00010000:3.0:1787758964.529043:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758964.529056:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d3e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea879a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787758964.529747:0:5821:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 649us 00010000:00010000:3.0:1787758964.535818:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.535841:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.535856:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.535877:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d3f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.535886:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.535899:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536486:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9000/0xa3b7f37aab2d3fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536495:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9000/0xa3b7f37aab2d3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536503:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9000/0xa3b7f37aab2d3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787758964.536600:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787758964.536604:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787758964.536700:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9000/0xa3b7f37aab2d3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536712:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536717:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536723:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536727:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b8600 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758964.536730:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536735:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536744:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f500) 00010000:00010000:3.0:1787758964.536746:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758964.536750:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536754:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d3f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536761:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536773:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d3f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536777:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536780:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b8800 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758964.536782:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536786:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d3f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536790:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99cce1b3ff00) 00010000:00010000:3.0:1787758964.536792:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758964.536794:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d3f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536797:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d3f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536825:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d3e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea879a expref: 8 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536837:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9000/0xa3b7f37aab2d3fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea879a expref: 7 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.536842:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cce1b3f600) 00010000:00010000:3.0:1787758964.536844:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787758964.536850:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf72b9000, rc 0) 00000100:00100000:3.0:1787758964.536905:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+7:10420:x1874601062705280:12345-192.168.201.54@tcp:101:touch.500 Request processed in 7880us (8009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758964.536913:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 19 00000100:00100000:1.0:1787758964.538303:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758964.538340:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062705536 00000100:00100000:0.0:1787758964.538348:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062705536 00000100:00100000:0.0:1787758964.538385:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 20 00000100:00100000:0.0:1787758964.538394:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+7:10420:x1874601062705536:12345-192.168.201.54@tcp:101:touch.500 00010000:00010000:0.0:1787758964.538408:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758964.538423:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fc800/0xa3b7f37aab2d405 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea87a1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.538612:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d40c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.538648:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d40c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.538658:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d40c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.538671:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d413 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.538677:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.538683:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787758964.539373:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787758964.539592:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d41a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.539599:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d41a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.539605:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d41a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.539652:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d40c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.539667:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d40c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.539672:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d40c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.539677:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccd96fd000 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758964.539679:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d40c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.539683:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d40c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.539689:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cce1b3f600) 00010000:00010000:0.0:1787758964.539691:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787758964.539694:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d40c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.539698:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d40c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787758964.539707:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a17877f1 reply state 00000000353dc34e transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758964.539715:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787758964.539732:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fc800/0xa3b7f37aab2d405 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87a1 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.539741:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d41a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87a1 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.539755:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99ccc705fc00) 00010000:00010000:0.0:1787758964.539757:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787758964.539759:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccd96fd800, rc 0) 00000100:00100000:0.0:1787758964.539789:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+10:10420:x1874601062705536:12345-192.168.201.54@tcp:101:touch.500 Request processed in 1398us (1488us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787758964.539794:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 20 00010000:00010000:3.0:1787758964.540332:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.540340:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d413 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.540345:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d413 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.540348:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccd96fce00 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758964.540350:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d413 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.540355:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d413 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.540363:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff99ccc705f700) 00010000:00010000:3.0:1787758964.540365:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758964.540367:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d413 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.540371:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d413 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758964.540930:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758964.541023:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062705792 00000100:00100000:2.0:1787758964.541039:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062705792 00000100:00100000:2.0:1787758964.541106:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 21 00000100:00100000:2.0:1787758964.541116:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+9:10420:x1874601062705792:12345-192.168.201.54@tcp:36:touch.500 00010000:00010000:2.0:1787758964.541165:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787758964.541188:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d41a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87a1 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.541222:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99ccc705fc00) 00010000:00010000:2.0:1787758964.541233:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787758964.541276:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5800/0xa3b7f37aab2d428 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.541290:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5800/0xa3b7f37aab2d428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.541298:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5800/0xa3b7f37aab2d428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787758964.541412:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6235cad reply state 00000000064a641b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5800/0xa3b7f37aab2d428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758964.541419:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787758964.541503:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+10:10420:x1874601062705792:12345-192.168.201.54@tcp:36:touch.500 Request processed in 389us (575us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787758964.541509:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 21 00010000:00010000:1.0:1787758964.542061:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5800/0xa3b7f37aab2d428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758964.542070:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5800/0xa3b7f37aab2d428 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758964.542076:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5800/0xa3b7f37aab2d428 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758964.542080:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d5800 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:1.0:1787758964.542083:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5800/0xa3b7f37aab2d428 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758964.542087:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5800/0xa3b7f37aab2d428 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758964.542102:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99ccd83ee700) 00010000:00010000:1.0:1787758964.542104:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758964.542107:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5800/0xa3b7f37aab2d428 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758964.542111:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5800/0xa3b7f37aab2d428 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758964.542204:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758964.542245:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062705920 00000100:00100000:0.0:1787758964.542251:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062705920 00000100:00100000:0.0:1787758964.542286:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 22 00000100:00100000:0.0:1787758964.542292:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+9:10420:x1874601062705920:12345-192.168.201.54@tcp:101:touch.500 00010000:00010000:0.0:1787758964.542303:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758964.542319:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0xa3b7f37aab2d42f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea87a8 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.542349:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0xa3b7f37aab2d42f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87a8 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.542358:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0xa3b7f37aab2d42f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87a8 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.542371:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99ccc705ff00) 00010000:00010000:0.0:1787758964.542373:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787758964.542375:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030200, rc 0) 00000100:00100000:0.0:1787758964.542407:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+10:10420:x1874601062705920:12345-192.168.201.54@tcp:101:touch.500 Request processed in 114us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758964.542426:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 22 00000100:00100000:1.0:1787758964.543232:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758964.543258:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062706048 00000100:00100000:3.0:1787758964.543263:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062706048 00000100:00100000:3.0:1787758964.543290:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:3.0:1787758964.543296:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874601062706048:12345-192.168.201.54@tcp:8:touch.500 00010000:00080000:3.0:1787758964.543328:0:6671:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 33089637-5953-4edf-8e89-39ecfabcd268@192.168.201.54@tcp t0 exp 0000000000000000 cur 114 last 0 00000020:00000080:3.0:1787758964.543358:0:6671:0:(genops.c:1385:class_connect()) connect: client 33089637-5953-4edf-8e89-39ecfabcd268, cookie 0xa3b7f37aab2d436 00002000:00100000:3.0:1787758964.543369:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 33089637-5953-4edf-8e89-39ecfabcd268/ffff99ccfd051000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787758964.543391:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787758964.543601:0:6671:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787758964.543657:0:6671:0:(import.c:65:import_set_state_nolock()) ffff99ccfd055800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787758964.543694:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33089637-5953-4edf-8e89-39ecfabcd268+6:2355:x1874601062706048:12345-192.168.201.54@tcp:8:touch.500 Request processed in 397us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758964.543701:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:1.0:1787758964.544370:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758964.544396:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062706176 00000100:00100000:3.0:1787758964.544401:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062706176 00000100:00080000:1.0:1787758964.544487:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787758964.544493:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:3.0:1787758964.544501:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33089637-5953-4edf-8e89-39ecfabcd268+6:0:x1874601062706176:12345-192.168.201.54@tcp:2:touch.500 00000001:00080000:1.0:1787758964.553708:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1787758964.553721:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 33089637-5953-4edf-8e89-39ecfabcd268 00000100:00100000:3.0:1787758964.553811:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33089637-5953-4edf-8e89-39ecfabcd268+5:0:x1874601062706176:12345-192.168.201.54@tcp:2:touch.500 Request processed in 9304us (9440us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787758964.553824:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:1.0:1787758964.554979:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758964.555027:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062706432 00000100:00100000:0.0:1787758964.555036:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062706432 00000100:00100000:0.0:1787758964.555075:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 2 00000100:00100000:0.0:1787758964.555086:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+10:10420:x1874601062706432:12345-192.168.201.54@tcp:35:touch.500 00000100:00100000:0.0:1787758964.555326:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+11:10420:x1874601062706432:12345-192.168.201.54@tcp:35:touch.500 Request processed in 241us (346us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787758964.555335:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 2 00000100:00100000:1.0:1787758964.559821:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758964.559863:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062706560 00000100:00100000:3.0:1787758964.559869:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062706560 00000100:00100000:3.0:1787758964.559905:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 23 00000100:00100000:3.0:1787758964.559911:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+11:10421:x1874601062706560:12345-192.168.201.54@tcp:101:rm.0 00010000:00010000:3.0:1787758964.559925:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758964.559954:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d43d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea87af expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.560010:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d444 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.560034:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.560047:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787758964.560094:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787758964.560098:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787758964.560132:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.560153:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d43d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87af expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.560167:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87af expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.560174:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cce1b3f600) 00010000:00010000:3.0:1787758964.560176:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787758964.560180:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf72b8800, rc 0) 00000100:00100000:3.0:1787758964.560213:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+12:10421:x1874601062706560:12345-192.168.201.54@tcp:101:rm.0 Request processed in 302us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758964.560218:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 23 00000100:00100000:1.0:1787758964.561175:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758964.561206:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062706816 00000100:00100000:3.0:1787758964.561210:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062706816 00000100:00100000:3.0:1787758964.561238:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 24 00000100:00100000:3.0:1787758964.561243:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+12:10421:x1874601062706816:12345-192.168.201.54@tcp:101:rm.0 00010000:00010000:3.0:1787758964.561250:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758964.561263:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d44b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea87b6 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787758964.561313:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787758964.561419:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d44b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87b6 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.561430:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f500) 00010000:00010000:3.0:1787758964.561432:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787758964.561435:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d44b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87b6 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.561443:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf72b8600, rc 0) 00000100:00100000:3.0:1787758964.561470:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+13:10421:x1874601062706816:12345-192.168.201.54@tcp:101:rm.0 Request processed in 227us (296us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1787758964.561475:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 24 00000100:00100000:1.0:1787758964.562797:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758964.562829:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062706944 00000100:00100000:3.0:1787758964.562833:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062706944 00000100:00100000:3.0:1787758964.562859:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 3 00000100:00100000:3.0:1787758964.562864:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33089637-5953-4edf-8e89-39ecfabcd268+13:10421:x1874601062706944:12345-192.168.201.54@tcp:37:rm.0 00000100:00100000:3.0:1787758964.564746:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33089637-5953-4edf-8e89-39ecfabcd268+13:10421:x1874601062706944:12345-192.168.201.54@tcp:37:rm.0 Request processed in 1878us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758964.564755:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 3 00000100:00100000:1.0:1787758964.565989:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758964.566025:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062707200 00000100:00100000:0.0:1787758964.566031:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062707200 00000100:00100000:0.0:1787758964.566057:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:0.0:1787758964.566063:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc5686050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+13:10421:x1874601062707200:12345-192.168.201.54@tcp:35:rm.0 00000100:00100000:0.0:1787758964.566173:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc5686050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+14:10421:x1874601062707200:12345-192.168.201.54@tcp:35:rm.0 Request processed in 108us (182us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787758964.566182:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:1.0:1787758964.567166:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758964.567230:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062707456 00000100:00100000:2.0:1787758964.567242:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062707456 00000100:00100000:2.0:1787758964.567301:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 25 00000100:00100000:2.0:1787758964.567311:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+14:10421:x1874601062707456:12345-192.168.201.54@tcp:101:rm.0 00010000:00010000:2.0:1787758964.567340:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758964.567357:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d459 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea87bd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.567475:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5a00/0xa3b7f37aab2d460 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.567505:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5a00/0xa3b7f37aab2d460 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.567514:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5a00/0xa3b7f37aab2d460 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787758964.567524:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787758964.567688:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d459 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87bd expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.567705:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5a00/0xa3b7f37aab2d460 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87bd expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.567713:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cce1b3f600) 00010000:00010000:2.0:1787758964.567715:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787758964.567718:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc79d5a00, rc 0) 00000100:00100000:2.0:1787758964.567774:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+16:10421:x1874601062707456:12345-192.168.201.54@tcp:101:rm.0 Request processed in 465us (609us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787758964.567779:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 25 00000100:00100000:1.0:1787758964.568813:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758964.568864:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062707584 00000100:00100000:0.0:1787758964.568869:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062707584 00000100:00100000:0.0:1787758964.568899:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 26 00000100:00100000:0.0:1787758964.568905:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+16:10421:x1874601062707584:12345-192.168.201.54@tcp:41:rm.0 00000004:00000024:0.0:1787758964.568963:0:5823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787758964.569006:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+16:10421:x1874601062707584:12345-192.168.201.54@tcp:41:rm.0 Request processed in 99us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758964.569015:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 26 00000100:00100000:1.0:1787758964.569783:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758964.569829:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062707712 00000100:00100000:3.0:1787758964.569836:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062707712 00000100:00100000:3.0:1787758964.569875:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 27 00000100:00100000:3.0:1787758964.569886:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+16:10421:x1874601062707712:12345-192.168.201.54@tcp:101:rm.0 00010000:00010000:3.0:1787758964.569908:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758964.569921:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d46e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea87c4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.569985:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d475 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570000:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d475 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570012:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d475 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570028:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d47c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570036:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d47c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570044:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d47c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570137:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9a00/0xa3b7f37aab2d483 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570148:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9a00/0xa3b7f37aab2d483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570157:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9a00/0xa3b7f37aab2d483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787758964.570181:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787758964.570192:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787758964.570209:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9a00/0xa3b7f37aab2d483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570222:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9a00/0xa3b7f37aab2d483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570232:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d475 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570240:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d475 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570249:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d475 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570257:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b9200 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758964.570262:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d475 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570272:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d475 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570285:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cce1b3f600) 00010000:00010000:3.0:1787758964.570290:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758964.570295:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d475 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570303:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9200/0xa3b7f37aab2d475 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570316:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d47c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570335:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d47c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570343:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d47c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570349:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b9400 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758964.570353:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d47c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570360:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d47c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570370:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff99cce1b3fb00) 00010000:00010000:3.0:1787758964.570373:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758964.570376:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d47c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570383:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9400/0xa3b7f37aab2d47c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570414:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8600/0xa3b7f37aab2d46e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87c4 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570429:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9a00/0xa3b7f37aab2d483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87c4 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.570437:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99ccc705ff00) 00010000:00010000:3.0:1787758964.570440:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787758964.570450:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf72b9a00, rc 0) 00000100:00100000:3.0:1787758964.570489:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+17:10421:x1874601062707712:12345-192.168.201.54@tcp:101:rm.0 Request processed in 605us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758964.570499:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 27 00000100:00100000:1.0:1787758964.571671:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758964.571704:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062707968 00000100:00100000:3.0:1787758964.571709:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062707968 00000100:00100000:3.0:1787758964.571735:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 28 00000100:00100000:3.0:1787758964.571742:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+17:10421:x1874601062707968:12345-192.168.201.54@tcp:36:rm.0 00010000:00010000:3.0:1787758964.571766:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787758964.571777:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9a00/0xa3b7f37aab2d483 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87c4 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.571789:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0xa3b7f37aab2d42f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87a8 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.571797:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99ccc705ff00) 00010000:00010000:3.0:1787758964.571807:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8800/0xa3b7f37aab2d444 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87af expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.571813:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cce1b3f600) 00010000:00010000:3.0:1787758964.571815:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787758964.571823:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d48a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.571829:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d48a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.571835:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d48a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.571851:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d491 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.571857:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.571862:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.571907:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d498 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.571912:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d498 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.571916:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d498 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787758964.572562:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787758964.572572:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 114846955002ns, next at 115846953285ns, rc = 0 00010000:00010000:3.0:1787758964.572629:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8a00/0xa3b7f37aab2d49f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.572639:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8a00/0xa3b7f37aab2d49f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.572648:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8a00/0xa3b7f37aab2d49f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.572654:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8a00/0xa3b7f37aab2d49f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.572667:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8a00/0xa3b7f37aab2d49f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.572672:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8a00/0xa3b7f37aab2d49f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.572689:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787758964.572701:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d498 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.572706:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d498 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.572710:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d498 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.572714:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b8400 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758964.572717:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d498 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.572719:0:8427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787758964.572726:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d498 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.572729:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8a00/0xa3b7f37aab2d49f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.572735:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cce1b3f300) 00010000:00010000:3.0:1787758964.572741:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787758964.572746:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d498 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.572748:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b8a00 already unused, calling callback (ffffffffc1666530) 00010000:00010000:0.0:1787758964.572754:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8a00/0xa3b7f37aab2d49f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.572757:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d498 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.572768:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8a00/0xa3b7f37aab2d49f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.572776:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d48a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.572781:0:8427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99cce1b3f300) 00010000:00010000:0.0:1787758964.572786:0:8427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787758964.572791:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8a00/0xa3b7f37aab2d49f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.572794:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d48a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.572798:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8a00/0xa3b7f37aab2d49f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.572805:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d48a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.572811:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b9600 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758964.572814:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d48a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.572815:0:8427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758964.572819:0:8427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758964.572821:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d48a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758964.572822:0:8427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787758964.572832:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cce1b3f600) 00010000:00010000:3.0:1787758964.572834:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758964.572836:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d48a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.572840:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d48a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787758964.572849:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ee2d508 reply state 0000000052c88e65 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758964.572856:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787758964.572891:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+16:10421:x1874601062707968:12345-192.168.201.54@tcp:36:rm.0 Request processed in 1150us (1223us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787758964.572897:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 28 00010000:00010000:3.0:1787758964.573475:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.573497:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d491 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.573504:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.573510:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b8200 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758964.573514:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.573521:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d491 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.573531:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff99cce1b3ff00) 00010000:00010000:3.0:1787758964.573534:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758964.573538:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d491 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.573544:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d491 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758964.573976:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758964.574006:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062708224 00000100:00100000:3.0:1787758964.574012:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062708224 00000100:00100000:0.0:1787758964.574080:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:0.0:1787758964.574098:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+15:10421:x1874601062708224:12345-192.168.201.54@tcp:35:rm.0 00000100:00100000:0.0:1787758964.574212:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+16:10421:x1874601062708224:12345-192.168.201.54@tcp:35:rm.0 Request processed in 124us (236us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787758964.574218:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:1.0:1787758964.574850:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758964.574896:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062708480 00000100:00100000:2.0:1787758964.574907:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062708480 00000100:00100000:2.0:1787758964.574965:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 29 00000100:00100000:2.0:1787758964.574975:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+16:10421:x1874601062708480:12345-192.168.201.54@tcp:36:rm.0 00010000:00010000:2.0:1787758964.575036:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787758964.575055:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5a00/0xa3b7f37aab2d460 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87bd expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.575084:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9000/0xa3b7f37aab2d3fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea879a expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.575098:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99cce1b3f600) 00010000:00010000:2.0:1787758964.575117:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d3bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea878c expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.575129:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f500) 00010000:00010000:2.0:1787758964.575138:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787758964.575156:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d4a6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.575166:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d4a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.575173:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d4a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.575181:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5400/0xa3b7f37aab2d4ad lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.575186:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5400/0xa3b7f37aab2d4ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.575190:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5400/0xa3b7f37aab2d4ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.575420:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d4b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.575434:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d4b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.575439:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d4b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787758964.575985:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787758964.575998:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d4b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.576003:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d4b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.576008:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d4b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.576013:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d4800 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:2.0:1787758964.576016:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d4b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.576022:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d4b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.576028:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99ccd83ee600) 00010000:00010000:2.0:1787758964.576030:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787758964.576033:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d4b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.576037:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d4b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.576050:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d4a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.576059:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d4a6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.576063:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d4a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.576066:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d5000 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:2.0:1787758964.576068:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d4a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.576072:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d4a6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.576076:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd83ee000) 00010000:00010000:2.0:1787758964.576078:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787758964.576081:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d4a6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758964.576087:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d4a6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787758964.576099:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001cb767ac reply state 0000000045900906 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5400/0xa3b7f37aab2d4ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758964.576108:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787758964.576177:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+15:10421:x1874601062708480:12345-192.168.201.54@tcp:36:rm.0 Request processed in 1203us (1326us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787758964.576182:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 29 00010000:00010000:3.0:1787758964.576781:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5400/0xa3b7f37aab2d4ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.576791:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5400/0xa3b7f37aab2d4ad lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.576796:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5400/0xa3b7f37aab2d4ad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.576809:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d5400 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758964.576812:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5400/0xa3b7f37aab2d4ad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.576817:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5400/0xa3b7f37aab2d4ad lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.576825:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99ccd83ee300) 00010000:00010000:3.0:1787758964.576827:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758964.576830:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5400/0xa3b7f37aab2d4ad lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758964.576835:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5400/0xa3b7f37aab2d4ad lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758964.602459:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758964.602593:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062708608 00000100:00100000:3.0:1787758964.602609:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062708608 00000100:00100000:3.0:1787758964.602697:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 201 00000100:00100000:3.0:1787758964.602714:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:2358:x1874601062708608:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1787758964.602802:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5453e3da-9a83-4395-adba-03dea8a5243b+10:2358:x1874601062708608:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 97us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758964.602809:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 201 00010000:00010000:1.0:1787758964.764810:0:8426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758965.788845:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758965.916797:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069023872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787758965.916878:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758965.916901:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069023872 00000100:00100000:2.0:1787758965.916929:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069023872 00000100:00080000:3.0:1787758965.916993:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787758965.916998:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787758965.917009:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069023872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787758965.917040:0:8593:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787758965.917083:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069023872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758965.917088:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787758965.917146:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf5ba6580 x1874601069023872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787758965.917168:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069023872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787758966.353148:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758966.353216:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062708736 00000100:00100000:0.0:1787758966.353226:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062708736 00000100:00080000:3.0:1787758966.353288:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787758966.353295:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 30 00000100:00100000:0.0:1787758966.353308:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+14:10931:x1874601062708736:12345-192.168.201.54@tcp:101:rm.0 00010000:00010000:0.0:1787758966.353334:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758966.353372:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0xa3b7f37aab2d4bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea87cb expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758966.353439:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d4c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758966.353453:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758966.353464:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787758966.353518:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787758966.353521:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787758966.353537:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758966.353556:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0xa3b7f37aab2d4bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87cb expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758966.353570:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d4c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87cb expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758966.353577:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f100) 00010000:00010000:0.0:1787758966.353579:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787758966.353582:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccd96fd400, rc 0) 00000100:00100000:0.0:1787758966.353664:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+15:10931:x1874601062708736:12345-192.168.201.54@tcp:101:rm.0 Request processed in 361us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758966.353670:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 30 00000100:00100000:1.0:1787758966.355667:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758966.355702:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062708864 00000100:00100000:3.0:1787758966.355707:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062708864 00000100:00100000:3.0:1787758966.355739:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 31 00000100:00100000:3.0:1787758966.355748:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+15:10931:x1874601062708864:12345-192.168.201.54@tcp:101:rm.0 00010000:00010000:3.0:1787758966.355767:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758966.355780:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d4c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea87d2 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.355820:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.355832:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.355841:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.356985:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d4d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.356996:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357002:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357052:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357060:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357069:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357075:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b9600 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758966.357086:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357092:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357101:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f100) 00010000:00010000:3.0:1787758966.357103:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758966.357106:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357111:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357120:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357124:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d4d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357128:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357132:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b8400 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758966.357133:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357137:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d4d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357141:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd1ea4b6 (ffff99cce1b3ff00) 00010000:00010000:3.0:1787758966.357143:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758966.357148:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d4d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357152:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d4d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357176:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d4c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87d2 expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357183:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f100) 00010000:00010000:3.0:1787758966.357185:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787758966.357188:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d4c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87d2 expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758966.357193:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf72b8200, rc 0) 00000100:00100000:3.0:1787758966.357233:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+15:10931:x1874601062708864:12345-192.168.201.54@tcp:101:rm.0 Request processed in 1488us (1567us total) trans 0 rc 301/301 00000100:00100000:3.0:1787758966.357238:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 31 00010000:00010000:0.0:1787758966.812868:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787758967.452862:0:8072:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 117727241585ns, next at 118727238513ns, rc = 0 00000100:00100000:2.0:1787758967.452879:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5d64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1874601069024000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787758967.452916:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874601069024256:0@lo:400:kworker.0 00000100:00100000:2.0:1787758967.452997:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758967.452997:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758967.453074:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069024768:0@lo:400:kworker.0 00000100:00100000:2.0:1787758967.453087:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1874601069024512:0@lo:400:kworker.0 00000100:00100000:3.0:1787758967.453105:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758967.453128:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758967.453130:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787758967.453137:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3293:1874601069024128:0@lo:400:kworker.0 00000100:00100000:2.0:1787758967.453163:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787758967.453173:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3291:1874601069024384:0@lo:400:kworker.0 00000100:00100000:2.0:1787758967.453205:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787758967.453242:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758967.453243:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069024768 00000100:00100000:2.0:1787758967.453252:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069024768 00000100:00100000:0.0:1787758967.453253:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069024256 00000100:00100000:0.0:1787758967.453258:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069024256 00000100:00100000:3.0:1787758967.453282:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3293:1874601069024640:0@lo:400:kworker.0 00000100:00100000:0.0:1787758967.453304:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069024384 00000100:00100000:2.0:1787758967.453305:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069024512 00000100:00100000:0.0:1787758967.453309:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069024384 00000100:00100000:2.0:1787758967.453309:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069024512 00000100:00100000:1.0:1787758967.453333:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069024000 00000100:00100000:1.0:1787758967.453340:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069024000 00000100:00100000:0.0:1787758967.453341:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787758967.453342:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787758967.453356:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf58821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874601069024256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787758967.453356:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc696a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1874601069024768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787758967.453415:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf58821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874601069024256:12345-0@lo:400:kworker.0 Request processed in 63us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758967.453415:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc696a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1874601069024768:12345-0@lo:400:kworker.0 Request processed in 61us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758967.453428:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787758967.453428:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787758967.453450:0:7144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787758967.453455:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787758967.453468:0:7144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1874601069024512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787758967.453470:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874601069024384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787758967.453470:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787758967.453476:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787758967.453484:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787758967.453487:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787758967.453506:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069024640 00000100:00100000:2.0:1787758967.453510:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069024640 00000100:00100000:3.0:1787758967.453518:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874601069024256:0@lo:400:kworker.0 00010000:00080000:3.0:1787758967.453549:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf5ba70c0 x1874601069024768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758967.453553:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874601069024384:12345-0@lo:400:kworker.0 Request processed in 88us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758967.453553:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787758967.453559:0:7144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3291:x1874601069024512:12345-0@lo:400:kworker.0 Request processed in 96us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758967.453568:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccffe5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874601069024640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787758967.453574:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787758967.453583:0:7144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787758967.453588:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069024768:0@lo:400:kworker.0 00000100:00100000:2.0:1787758967.453644:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccffe5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874601069024640:12345-0@lo:400:kworker.0 Request processed in 78us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787758967.453653:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3293:1874601069024640:0@lo:400:kworker.0 00000100:00100000:2.0:1787758967.453654:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787758967.453681:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787758967.453709:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3291:1874601069024384:0@lo:400:kworker.0 00010000:00080000:2.0:1787758967.453730:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf5ba5a40 x1874601069024512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787758983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787758967.453742:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1874601069024512:0@lo:400:kworker.0 00000100:00100000:1.0:1787758967.453750:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787758967.453764:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874601069024000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787758967.453801:0:6672:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787758967.453809:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069024128 00000100:00100000:0.0:1787758967.453815:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069024128 00010000:00080000:3.0:1787758967.453857:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ccf5d64780 x1874601069024000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787758983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787758967.453858:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787758967.453865:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1874601069024000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758967.453874:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3293:x1874601069024128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758967.453886:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787758967.453902:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5d64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3291:1874601069024000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787758967.453961:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3293:x1874601069024128:12345-0@lo:400:kworker.0 Request processed in 89us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758967.453971:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787758967.453972:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3293:1874601069024128:0@lo:400:kworker.0 00010000:00010000:2.0:1787758967.836834:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758968.860696:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758969.722783:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758969.722828:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062708992 00000100:00100000:3.0:1787758969.722840:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062708992 00000100:00100000:1.0:1787758969.722881:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758969.722954:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062709120 00000100:00100000:0.0:1787758969.722960:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062709120 00000100:00100000:2.0:1787758969.722965:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 203 00000100:00100000:2.0:1787758969.722984:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+10:2357:x1874601062708992:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1787758969.723026:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758969.723034:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 34 00000100:00100000:1.0:1787758969.723060:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062709248 00000100:00100000:1.0:1787758969.723066:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062709248 00000100:00100000:2.0:1787758969.723068:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5453e3da-9a83-4395-adba-03dea8a5243b+10:2357:x1874601062708992:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 88us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758969.723070:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+15:2356:x1874601062709120:12345-192.168.201.54@tcp:400:kworker.0 00000100:00080000:3.0:1787758969.723072:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787758969.723084:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787758969.723088:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 203 00000100:00100000:0.0:1787758969.723117:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+15:2356:x1874601062709120:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 72us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758969.723124:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 24 00000100:00100000:0.0:1787758969.723151:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 34 00000100:00100000:1.0:1787758969.723158:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33089637-5953-4edf-8e89-39ecfabcd268+5:2357:x1874601062709248:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1787758969.723200:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33089637-5953-4edf-8e89-39ecfabcd268+5:2357:x1874601062709248:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 57us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758969.723209:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 24 00010000:00010000:0.0:1787758969.884841:0:8427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787758970.022318:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1787758970.022342:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1787758970.022357:0:5843:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1787758970.022369:0:5843:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787758970.022475:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccffe5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069024896:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787758970.022550:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758970.022574:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069024896 00000100:00100000:2.0:1787758970.022581:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069024896 00000100:00080000:3.0:1787758970.022635:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787758970.022654:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787758970.022663:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069024896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787758970.022685:0:6670:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787758970.022711:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8f0975, atime: 0x6a8f0975, ctime: 0x6a8f0975, blocks: 0x1 00010000:00010000:2.0:1787758970.022717:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004455f0c6/0xa3b7f37aab2d4de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758970.022740:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=120s v=(0 0) 00010000:00010000:2.0:1787758970.022744:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787758970.022749:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004455f0c6/0xa3b7f37aab2d4de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758970.022761:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004455f0c6/0xa3b7f37aab2d4de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758970.022769:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004455f0c6/0xa3b7f37aab2d4de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758970.022775:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004455f0c6/0xa3b7f37aab2d4de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758970.022795:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787758970.022815:0:8426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787758970.022824:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004455f0c6/0xa3b7f37aab2d4de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.022837:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d5c00 already unused, calling callback (ffffffffc1666530) 00010000:00010000:1.0:1787758970.022853:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004455f0c6/0xa3b7f37aab2d4de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.022865:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004455f0c6/0xa3b7f37aab2d4de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.022886:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004455f0c6/0xa3b7f37aab2d4de lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.022895:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004455f0c6/0xa3b7f37aab2d4de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.022913:0:8426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758970.022915:0:8426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787758970.022918:0:8426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787758970.023192:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3290:x1874601069024896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 530us (643us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787758970.023198:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1787758970.023242:0:3290:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99ccffe5e940/2, rc 0, transno 4294967300 00000100:00100000:0.0:1787758970.023247:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccffe5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069024896:0@lo:6:osp-syn-1-0.0 00000001:02000400:2.0:1787758970.601119:0:11966:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 460e: verify mmap is enabled with compressed files ========================================================== 11:42:51 (1787758971) 00000100:00100000:3.0:1787758970.655455:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1787758970.655490:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062709376 00000100:00100000:3.0:1787758970.655499:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062709376 00000100:00100000:3.0:1787758970.655538:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 32 00000100:00100000:3.0:1787758970.655547:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccffe5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+6:11787:x1874601062709376:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:3.0:1787758970.655567:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787758970.655588:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d4e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea87d9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.655674:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d4ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.655695:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d4ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.655705:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d4ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.655716:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.655722:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.655727:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.656009:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d4ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.656015:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d4ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.656020:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d4ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.656025:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b8200 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758970.656028:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d4ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.656034:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d4ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.656047:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f100) 00010000:00010000:3.0:1787758970.656055:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758970.656060:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d4ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.656065:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8200/0xa3b7f37aab2d4ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.656074:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.656078:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.656083:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.656087:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf72b9600 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758970.656088:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.656092:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.656098:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa28e36b1 (ffff99cce1b3f900) 00010000:00010000:3.0:1787758970.656100:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758970.656101:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.656105:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b9600/0xa3b7f37aab2d4f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.656130:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d4e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87d9 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.656147:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f100) 00010000:00010000:3.0:1787758970.656149:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758970.656152:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf72b8400/0xa3b7f37aab2d4e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87d9 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.656159:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf72b8400, rc 0) 00000100:00100000:3.0:1787758970.656209:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccffe5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+6:11787:x1874601062709376:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 664us (760us total) trans 0 rc 301/301 00000100:00100000:3.0:1787758970.656215:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 32 00000100:00100000:3.0:1787758970.659321:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758970.659370:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062709632 00000100:00100000:0.0:1787758970.659379:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062709632 00000100:00100000:0.0:1787758970.659442:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 33 00000100:00100000:0.0:1787758970.659453:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccffe5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+6:11787:x1874601062709632:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1787758970.659469:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758970.659472:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787758970.659493:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd400/0xa3b7f37aab2d4c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87cb expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.659510:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f100) 00010000:00010000:0.0:1787758970.659521:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787758970.659535:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d4fa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea87e0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.660129:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d501 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.660165:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d501 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.660178:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d501 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.660195:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fc800/0xa3b7f37aab2d508 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.660205:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fc800/0xa3b7f37aab2d508 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.660214:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fc800/0xa3b7f37aab2d508 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.661730:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d50f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.661742:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d50f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.661751:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d50f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787758970.661762:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 0 00010000:00010000:0.0:1787758970.661805:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d501 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.661816:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d501 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.661824:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d501 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.661856:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccd96fd800 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758970.661861:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d501 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.661869:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d501 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.661882:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f300) 00010000:00010000:0.0:1787758970.661886:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787758970.661891:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d501 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.661899:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd800/0xa3b7f37aab2d501 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787758970.661930:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b442084 reply state 0000000062db4119 transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fc800/0xa3b7f37aab2d508 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758970.661940:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787758970.661991:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fce00/0xa3b7f37aab2d4fa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87e0 expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.662021:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d50f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87e0 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.662031:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ccc705f800) 00010000:00010000:0.0:1787758970.662034:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787758970.662038:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccd96fd000, rc 0) 00000100:00100000:0.0:1787758970.662107:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccffe5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+8:11787:x1874601062709632:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 2653us (2787us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787758970.662124:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 33 00010000:00010000:3.0:1787758970.662992:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fc800/0xa3b7f37aab2d508 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.663000:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fc800/0xa3b7f37aab2d508 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.663005:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fc800/0xa3b7f37aab2d508 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.663009:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccd96fc800 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:3.0:1787758970.663012:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fc800/0xa3b7f37aab2d508 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.663018:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fc800/0xa3b7f37aab2d508 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.663026:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa28e36b1 (ffff99ccc705f600) 00010000:00010000:3.0:1787758970.663028:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787758970.663036:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fc800/0xa3b7f37aab2d508 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787758970.663041:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fc800/0xa3b7f37aab2d508 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758970.665042:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758970.665086:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062709888 00000100:00100000:0.0:1787758970.665094:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062709888 00000100:00100000:0.0:1787758970.665140:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 34 00000100:00100000:0.0:1787758970.665150:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfccd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+7:11787:x1874601062709888:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1787758970.665167:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758970.665182:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0xa3b7f37aab2d51d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea87e7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.665251:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d524 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.665264:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d50f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87e0 expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.665274:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d524 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.665306:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d50f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87e0 expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.665321:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d50f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87e0 expref: 8 pid: 5822 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758970.665335:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1874601069025024:192.168.201.54@tcp:104: 00000100:00100000:0.0:1787758970.665402:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd102540 going to sleep for 11 seconds 00000100:00100000:0.0:1787758970.666315:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba4f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1874601069025024:192.168.201.54@tcp:104: 00010000:00010000:0.0:1787758970.666336:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d524 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758970.666857:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758970.666901:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062710016 00000100:00100000:2.0:1787758970.666906:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062710016 00010000:00010000:2.0:1787758970.666926:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d50f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87e0 expref: 9 pid: 5822 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758970.666949:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 28 00000100:00100000:2.0:1787758970.666955:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfccd6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33089637-5953-4edf-8e89-39ecfabcd268+9:2356:x1874601062710016:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787758970.666978:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787758970.666983:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d50f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87e0 expref: 9 pid: 5822 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758970.666993:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d50f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87e0 expref: 9 pid: 5822 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758970.667004:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccd96fd000/0xa3b7f37aab2d50f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87e0 expref: 9 pid: 5822 timeout: 220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758970.667016:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ccc705f800) 00010000:00010000:2.0:1787758970.667020:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d524 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758970.667025:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d524 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758970.667030:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d524 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758970.667044:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787758970.667069:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfccd6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33089637-5953-4edf-8e89-39ecfabcd268+8:2356:x1874601062710016:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 114us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758970.667077:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 28 00010000:00010000:0.0:1787758970.667081:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d524 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.667092:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d524 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787758970.667105:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 0 00000004:00080000:0.0:1787758970.667344:0:5821:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787758970.667440:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d524 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.667447:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d524 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.667452:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d524 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.667456:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf5d53000 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758970.667459:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d524 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.667463:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d524 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.667470:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ccc705f800) 00010000:00010000:0.0:1787758970.667472:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787758970.667475:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d524 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.667487:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d524 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.667515:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0xa3b7f37aab2d51d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87e7 expref: 8 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.667522:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f400) 00010000:00010000:0.0:1787758970.667525:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787758970.667529:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc0030200/0xa3b7f37aab2d51d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87e7 expref: 8 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.667542:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc0030200, rc 0) 00000100:00100000:0.0:1787758970.667582:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfccd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+7:11787:x1874601062709888:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 2433us (2586us total) trans 4294967310 rc 301/301 00000100:00100000:0.0:1787758970.667588:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 34 00000100:00100000:3.0:1787758970.668990:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758970.669029:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062710272 00000100:00100000:1.0:1787758970.669034:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062710272 00000100:00100000:1.0:1787758970.669067:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:1.0:1787758970.669084:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfccd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33089637-5953-4edf-8e89-39ecfabcd268+7:11787:x1874601062710272:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:1.0:1787758970.669255:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfccd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33089637-5953-4edf-8e89-39ecfabcd268+8:11787:x1874601062710272:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 173us (266us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787758970.669264:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:1.0:1787758970.670263:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758970.670305:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062710528 00000100:00100000:0.0:1787758970.670312:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062710528 00000100:00100000:0.0:1787758970.670348:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:1.0:1787758970.670355:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1787758970.670362:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+8:11787:x1874601062710528:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:1.0:1787758970.670364:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1787758970.670488:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+9:11787:x1874601062710528:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 130us (225us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787758970.670498:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:3.0:1787758970.677275:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758970.677325:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062710656 00000100:00100000:2.0:1787758970.677331:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062710656 00000100:00100000:2.0:1787758970.677367:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 35 00000100:00100000:2.0:1787758970.677373:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfccd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+9:11789:x1874601062710656:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:2.0:1787758970.677398:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758970.677415:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d532 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea87ee expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758970.677472:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4000/0xa3b7f37aab2d539 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758970.677482:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4000/0xa3b7f37aab2d539 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758970.677490:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4000/0xa3b7f37aab2d539 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787758970.677528:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787758970.677531:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787758970.677570:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4000/0xa3b7f37aab2d539 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758970.677588:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d532 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87ee expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758970.677602:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4000/0xa3b7f37aab2d539 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87ee expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758970.677644:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd83ee800) 00010000:00010000:2.0:1787758970.677649:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787758970.677653:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc79d4000, rc 0) 00000100:00100000:2.0:1787758970.677703:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfccd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+10:11789:x1874601062710656:12345-192.168.201.54@tcp:101:dd.0 Request processed in 329us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758970.677709:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 35 00000100:00100000:3.0:1787758970.679670:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758970.679745:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062710912 00000100:00100000:1.0:1787758970.679750:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062710912 00000100:00100000:1.0:1787758970.679782:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 36 00000100:00100000:1.0:1787758970.679792:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfccd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+10:11789:x1874601062710912:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:1.0:1787758970.679803:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758970.679806:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787758970.679823:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4000/0xa3b7f37aab2d539 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87ee expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.679852:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd83ee800) 00010000:00010000:1.0:1787758970.679861:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787758970.679873:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17ac00/0xa3b7f37aab2d540 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea87f5 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.679982:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d547 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.679990:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d547 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.679996:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d547 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680015:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d54e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680022:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d54e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680027:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d54e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680076:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17bc00/0xa3b7f37aab2d555 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680081:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17bc00/0xa3b7f37aab2d555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680086:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17bc00/0xa3b7f37aab2d555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787758970.680092:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 0 00010000:00010000:1.0:1787758970.680166:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d547 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680175:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d547 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680182:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d547 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680187:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccfd17a600 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:1.0:1787758970.680190:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d547 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680204:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d547 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680210:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd9d5ca00) 00010000:00010000:1.0:1787758970.680212:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758970.680216:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d547 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680220:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d547 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680226:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d54e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680230:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d54e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680234:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d54e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680238:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccfd17aa00 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:1.0:1787758970.680240:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d54e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680247:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d54e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680254:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa28e36b1 (ffff99ccd9d5c500) 00010000:00010000:1.0:1787758970.680257:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758970.680260:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d54e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680276:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d54e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680308:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17ac00/0xa3b7f37aab2d540 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87f5 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680318:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17bc00/0xa3b7f37aab2d555 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87f5 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.680323:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ccd9d5c300) 00010000:00010000:1.0:1787758970.680325:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787758970.680327:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccfd17bc00, rc 0) 00000100:00100000:1.0:1787758970.680356:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfccd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+11:11789:x1874601062710912:12345-192.168.201.54@tcp:101:dd.0 Request processed in 567us (691us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787758970.680361:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 36 00000100:00100000:3.0:1787758970.682303:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758970.682356:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062711168 00000100:00100000:0.0:1787758970.682364:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062711168 00000100:00100000:0.0:1787758970.682405:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 37 00000100:00100000:0.0:1787758970.682416:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfccd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+11:11789:x1874601062711168:12345-192.168.201.54@tcp:36:dd.0 00010000:00010000:0.0:1787758970.682459:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787758970.682473:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17bc00/0xa3b7f37aab2d555 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87f5 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.682488:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ccd9d5c300) 00010000:00010000:0.0:1787758970.682495:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787758970.682700:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d563 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.682711:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.682720:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787758970.682771:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967314 00000004:00010000:0.0:1787758970.682807:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c86a4b3 reply state 00000000ae484626 transno 4294967315 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758970.682816:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787758970.682897:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfccd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+13:11789:x1874601062711168:12345-192.168.201.54@tcp:36:dd.0 Request processed in 482us (593us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787758970.682905:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 37 00000020:00080000:0.0:1787758970.682911:0:5822:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787758970.683612:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.683641:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d563 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.683650:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d563 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.683658:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf5d53000 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:1.0:1787758970.683662:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d563 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.683670:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d563 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.683690:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ccc705f400) 00010000:00010000:1.0:1787758970.683693:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758970.683697:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d563 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.683705:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53000/0xa3b7f37aab2d563 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758970.684156:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758970.684193:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062711296 00000100:00100000:0.0:1787758970.684197:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062711296 00000100:00100000:0.0:1787758970.684223:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 38 00000100:00100000:0.0:1787758970.684228:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfccd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+12:11789:x1874601062711296:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:0.0:1787758970.684237:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758970.684250:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53a00/0xa3b7f37aab2d56a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea87fc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.684273:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53a00/0xa3b7f37aab2d56a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87fc expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.684281:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53a00/0xa3b7f37aab2d56a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87fc expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758970.684293:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ccc705f800) 00010000:00010000:0.0:1787758970.684296:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787758970.684298:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf5d53a00, rc 0) 00000100:00100000:0.0:1787758970.684323:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfccd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+13:11789:x1874601062711296:12345-192.168.201.54@tcp:101:dd.0 Request processed in 95us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758970.684328:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 38 00000100:00100000:3.0:1787758970.686203:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758970.686242:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062711424 00000100:00100000:2.0:1787758970.686247:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062711424 00000100:00100000:2.0:1787758970.686272:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:2.0:1787758970.686277:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfccd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1874601062711424:12345-192.168.201.54@tcp:8:dd.0 00010000:00080000:2.0:1787758970.686298:0:6669:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 33089637-5953-4edf-8e89-39ecfabcd268@192.168.201.54@tcp t0 exp 0000000000000000 cur 120 last 0 00000020:00000080:2.0:1787758970.686322:0:6669:0:(genops.c:1385:class_connect()) connect: client 33089637-5953-4edf-8e89-39ecfabcd268, cookie 0xa3b7f37aab2d571 00002000:00100000:2.0:1787758970.686331:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 33089637-5953-4edf-8e89-39ecfabcd268/ffff99ccfd10f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787758970.686349:0:6669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787758970.686508:0:6669:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787758970.686550:0:6669:0:(import.c:65:import_set_state_nolock()) ffff99ccfd108800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787758970.686598:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfccd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33089637-5953-4edf-8e89-39ecfabcd268+6:2355:x1874601062711424:12345-192.168.201.54@tcp:8:dd.0 Request processed in 320us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758970.686610:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:3.0:1787758970.687601:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758970.687654:0:7144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062711552 00000100:00100000:1.0:1787758970.687659:0:7144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062711552 00000100:00080000:3.0:1787758970.687701:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787758970.687713:0:7144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:1.0:1787758970.687725:0:7144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfccd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33089637-5953-4edf-8e89-39ecfabcd268+6:11789:x1874601062711552:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:1.0:1787758970.687733:0:7144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758970.687746:0:7144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cb404c6/0xa3b7f37aab2d578 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8803 expref: -99 pid: 7144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787758970.687763:0:7144:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787758970.687774:0:7144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=120s v=(0 0) 00010000:00010000:1.0:1787758970.687778:0:7144:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787758970.687783:0:7144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cb404c6/0xa3b7f37aab2d578 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8803 expref: 7 pid: 7144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.687796:0:7144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008cb404c6/0xa3b7f37aab2d578 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8803 expref: 7 pid: 7144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758970.687804:0:7144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccfd17a000, rc 0) 00000100:00100000:1.0:1787758970.687845:0:7144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfccd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33089637-5953-4edf-8e89-39ecfabcd268+7:11789:x1874601062711552:12345-192.168.201.54@tcp:101:dd.0 Request processed in 109us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758970.687858:0:7144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:3.0:1787758970.689006:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758970.689045:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062711680 00000100:00100000:1.0:1787758970.689050:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062711680 00002000:00010000:1.0:1787758970.689065:0:6674:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2 (0->18446744073709551615) 00002000:00100000:1.0:1787758970.689069:0:6674:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccfccd7c00 with x1874601062711680 ext(0->18446744073709551615) 00002000:00010000:1.0:1787758970.689075:0:6674:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccfccd7c00. 00000100:00100000:1.0:1787758970.689094:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:1.0:1787758970.689100:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfccd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:33089637-5953-4edf-8e89-39ecfabcd268+7:2357:x1874601062711680:12345-192.168.201.54@tcp:10:dd.0 00000001:00080000:2.0:1787758970.699240:0:6696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1787758970.699254:0:6696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 33089637-5953-4edf-8e89-39ecfabcd268 00002000:00010000:1.0:1787758970.699273:0:6674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787758970.699277:0:6674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787758971 00002000:00010000:1.0:1787758970.699280:0:6674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787758970.699282:0:6674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787758971 00002000:00010000:1.0:1787758970.699283:0:6674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:1.0:1787758970.699347:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfccd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:33089637-5953-4edf-8e89-39ecfabcd268+6:2357:x1874601062711680:12345-192.168.201.54@tcp:10:dd.0 Request processed in 10239us (10333us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787758970.699359:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 0 00002000:00010000:1.0:1787758970.699365:0:6674:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/2 (0->18446744073709551615) 00002000:00100000:1.0:1787758970.699369:0:6674:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccfccd7c00 with x1874601062711680 ext(0->18446744073709551615) 00002000:00010000:1.0:1787758970.699377:0:6674:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccfccd7c00. 00000100:00100000:3.0:1787758970.712516:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758970.712571:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062711936 00000100:00100000:0.0:1787758970.712580:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062711936 00000100:00100000:0.0:1787758970.712648:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:0.0:1787758970.712667:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfccd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+13:11789:x1874601062711936:12345-192.168.201.54@tcp:35:dd.0 00000100:00100000:0.0:1787758970.712982:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfccd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+14:11789:x1874601062711936:12345-192.168.201.54@tcp:35:dd.0 Request processed in 325us (474us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787758970.712988:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:3.0:1787758970.769647:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758970.769755:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062712064 00000100:00100000:1.0:1787758970.769784:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062712064 00002000:00100000:1.0:1787758970.769876:0:6676:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->135167) req@ffff99ccfccd4f00 x1874601062712064/t0(0) o4->33089637-5953-4edf-8e89-39ecfabcd268@192.168.201.54@tcp:521/0 lens 520/0 e 0 to 0 dl 1787758981 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787758970.769889:0:6676:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccfccd4f00 with x1874601062712064 ext(0->135167) 00002000:00010000:1.0:1787758970.769920:0:6676:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccfccd4f00 00000100:00100000:1.0:1787758970.769978:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 1 00000100:00100000:1.0:1787758970.769986:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfccd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:33089637-5953-4edf-8e89-39ecfabcd268+6:2359:x1874601062712064:12345-192.168.201.54@tcp:4:dd.0 00000100:00100000:1.0:1787758970.771434:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfccd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:33089637-5953-4edf-8e89-39ecfabcd268+8:2359:x1874601062712064:12345-192.168.201.54@tcp:4:dd.0 Request processed in 1447us (1822us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787758970.771443:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 1 00002000:00100000:1.0:1787758970.771452:0:6676:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2:0x0] (0->135167) req@ffff99ccfccd4f00 x1874601062712064/t4294967300(0) o4->33089637-5953-4edf-8e89-39ecfabcd268@192.168.201.54@tcp:521/0 lens 520/456 e 0 to 0 dl 1787758981 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787758970.771463:0:6676:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccfccd4f00 with x1874601062712064 ext(0->135167) 00002000:00010000:1.0:1787758970.771467:0:6676:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccfccd4f00 00010000:00010000:2.0:1787758970.908798:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787758971.036807:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787758971.036849:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069025152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787758971.036910:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758971.036957:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069025152 00000100:00100000:2.0:1787758971.036967:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069025152 00000100:00080000:3.0:1787758971.036999:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787758971.037037:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787758971.037058:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069025152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787758971.037082:0:8593:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787758971.037136:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3290:x1874601069025152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758971.037144:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787758971.037189:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069025152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787758971.132077:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758971.132189:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062712192 00000100:00100000:2.0:1787758971.132199:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062712192 00000100:00080000:3.0:1787758971.132269:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787758971.132288:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 39 00000100:00100000:2.0:1787758971.132301:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfccd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+14:11799:x1874601062712192:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1787758971.132325:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758971.132345:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d57f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea880a expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.132407:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5c00/0xa3b7f37aab2d586 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.132417:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5c00/0xa3b7f37aab2d586 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.132426:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5c00/0xa3b7f37aab2d586 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787758971.132482:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787758971.132487:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787758971.132515:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5c00/0xa3b7f37aab2d586 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.132536:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d57f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea880a expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.132550:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5c00/0xa3b7f37aab2d586 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea880a expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.132564:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd83ee600) 00010000:00010000:2.0:1787758971.132567:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787758971.132570:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc79d5c00, rc 0) 00000100:00100000:2.0:1787758971.132657:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfccd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+15:11799:x1874601062712192:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 360us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758971.132669:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 39 00000100:00100000:3.0:1787758971.134378:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758971.134426:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062712448 00000100:00100000:1.0:1787758971.134432:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062712448 00000100:00100000:1.0:1787758971.134475:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 40 00000100:00100000:1.0:1787758971.134487:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfccd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+15:11799:x1874601062712448:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:1.0:1787758971.134499:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758971.134511:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17ac00/0xa3b7f37aab2d58d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8811 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134555:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d594 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134563:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d594 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134578:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d594 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134587:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d59b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134592:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d59b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134597:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d59b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134686:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d594 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134691:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d594 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134695:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d594 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134699:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccfd17aa00 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:1.0:1787758971.134702:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d594 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134708:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d594 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134715:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd83ee600) 00010000:00010000:1.0:1787758971.134717:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758971.134719:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d594 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134729:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d594 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134736:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d59b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134740:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d59b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134744:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d59b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134747:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccfd17a600 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:1.0:1787758971.134749:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d59b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134753:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d59b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134757:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa28e36b1 (ffff99ccd9d5c500) 00010000:00010000:1.0:1787758971.134759:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758971.134761:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d59b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134764:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d59b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134783:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17ac00/0xa3b7f37aab2d58d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8811 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134799:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd83ee600) 00010000:00010000:1.0:1787758971.134800:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787758971.134803:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17ac00/0xa3b7f37aab2d58d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8811 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.134810:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccfd17ac00, rc 0) 00000100:00100000:1.0:1787758971.134854:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfccd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+15:11799:x1874601062712448:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 372us (478us total) trans 0 rc 301/301 00000100:00100000:1.0:1787758971.134859:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 40 00000100:00100000:3.0:1787758971.136354:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758971.136396:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062712576 00000100:00100000:0.0:1787758971.136401:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062712576 00000100:00100000:0.0:1787758971.136431:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 41 00000100:00100000:0.0:1787758971.136437:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfccd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+15:11799:x1874601062712576:12345-192.168.201.54@tcp:34:lfs.0 00010000:00010000:0.0:1787758971.136470:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136485:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136492:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136501:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136505:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136510:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136548:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d5b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136554:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136558:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787758971.136577:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 163840 00000004:00200000:0.0:1787758971.136580:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787758971.136586:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136601:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136630:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136636:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136641:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf5d53400 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758971.136643:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136648:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136655:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd83ee600) 00010000:00010000:0.0:1787758971.136657:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787758971.136659:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136664:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136670:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136674:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136678:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136681:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf5d52800 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758971.136687:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136692:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136696:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa28e36b1 (ffff99ccc705f100) 00010000:00010000:0.0:1787758971.136698:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787758971.136700:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136703:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136712:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136717:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d5b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136721:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136724:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf5d52600 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758971.136725:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136729:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d5b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136733:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ccc705f800) 00010000:00010000:0.0:1787758971.136734:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787758971.136739:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d5b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.136743:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d5b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758971.136785:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfccd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+15:11799:x1874601062712576:12345-192.168.201.54@tcp:34:lfs.0 Request processed in 349us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758971.136790:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 41 00000100:00100000:3.0:1787758971.145909:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758971.145968:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062712832 00000100:00100000:0.0:1787758971.145979:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062712832 00000100:00100000:0.0:1787758971.146028:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 42 00000100:00100000:0.0:1787758971.146038:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfccd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+15:11800:x1874601062712832:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1787758971.146060:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758971.146075:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d5b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8818 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146128:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146140:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146149:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146158:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146163:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146182:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146255:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146260:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146265:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146269:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf5d52800 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758971.146273:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146277:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146285:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd83ee600) 00010000:00010000:0.0:1787758971.146287:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787758971.146291:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146295:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d5be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146303:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146307:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146316:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146320:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf5d53400 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758971.146321:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146325:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146330:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa28e36b1 (ffff99ccc705f100) 00010000:00010000:0.0:1787758971.146331:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787758971.146333:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146337:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d5c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146359:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d5b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8818 expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146366:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd83ee600) 00010000:00010000:0.0:1787758971.146368:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787758971.146370:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d5b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8818 expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.146377:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf5d52600, rc 0) 00000100:00100000:0.0:1787758971.146421:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfccd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+15:11800:x1874601062712832:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 386us (522us total) trans 0 rc 301/301 00000100:00100000:0.0:1787758971.146434:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 42 00000100:00100000:3.0:1787758971.148216:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758971.148268:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062712960 00000100:00100000:2.0:1787758971.148273:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062712960 00000100:00100000:2.0:1787758971.148307:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 43 00000100:00100000:2.0:1787758971.148316:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccfccd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+15:11800:x1874601062712960:12345-192.168.201.54@tcp:34:lfs.0 00010000:00010000:2.0:1787758971.148354:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d5cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148364:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d5cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148370:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d5cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148377:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d5d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148382:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148387:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148424:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d5da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148429:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d5da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148433:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d5da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787758971.148468:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 163840 00000004:00200000:2.0:1787758971.148471:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787758971.148480:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d5da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148488:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d5cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148503:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d5cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148507:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d5cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148511:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d4c00 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:2.0:1787758971.148513:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d5cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148518:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d5cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148524:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd83ee600) 00010000:00010000:2.0:1787758971.148526:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787758971.148528:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d5cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148532:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d5cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148543:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148560:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d5d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148567:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148573:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d4a00 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:2.0:1787758971.148577:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148584:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d5d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148593:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa28e36b1 (ffff99ccd83ee800) 00010000:00010000:2.0:1787758971.148595:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787758971.148597:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d5d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148602:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d5d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148611:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d5da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148641:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d5da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148648:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d5da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148653:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d4400 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:2.0:1787758971.148662:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d5da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148667:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d5da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148673:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ccc705f800) 00010000:00010000:2.0:1787758971.148675:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787758971.148678:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d5da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.148684:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d5da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758971.148735:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccfccd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+15:11800:x1874601062712960:12345-192.168.201.54@tcp:34:lfs.0 Request processed in 420us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758971.148742:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 43 00000100:00100000:3.0:1787758971.195037:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758971.195101:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062713216 00000100:00100000:1.0:1787758971.195111:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062713216 00000100:00100000:1.0:1787758971.195170:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 44 00000100:00100000:1.0:1787758971.195179:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+15:11802:x1874601062713216:12345-192.168.201.54@tcp:101:multiop.0 00010000:00010000:1.0:1787758971.195198:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758971.195200:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787758971.195222:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5c00/0xa3b7f37aab2d586 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea880a expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195239:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd83ee600) 00010000:00010000:1.0:1787758971.195248:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787758971.195259:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17ac00/0xa3b7f37aab2d5e1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea881f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195383:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d5e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195406:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d5e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195416:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d5e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195432:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d5ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195440:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d5ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195448:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d5ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195519:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17b200/0xa3b7f37aab2d5f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195527:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17b200/0xa3b7f37aab2d5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195533:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17b200/0xa3b7f37aab2d5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787758971.195541:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 163840 00010000:00010000:1.0:1787758971.195674:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d5e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195684:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d5e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195692:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d5e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195703:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccfd17a600 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:1.0:1787758971.195707:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d5e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195712:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d5e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195719:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd9d5c500) 00010000:00010000:1.0:1787758971.195721:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758971.195723:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d5e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195728:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a600/0xa3b7f37aab2d5e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195735:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d5ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195740:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d5ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195744:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d5ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195747:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccfd17aa00 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:1.0:1787758971.195749:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d5ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195752:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d5ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195763:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa28e36b1 (ffff99ccd9d5ca00) 00010000:00010000:1.0:1787758971.195765:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758971.195767:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d5ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195771:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d5ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195841:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17ac00/0xa3b7f37aab2d5e1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea881f expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195865:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17b200/0xa3b7f37aab2d5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea881f expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.195873:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ccc705f800) 00010000:00010000:1.0:1787758971.195876:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787758971.195879:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccfd17b200, rc 0) 00000100:00100000:1.0:1787758971.195930:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+16:11802:x1874601062713216:12345-192.168.201.54@tcp:101:multiop.0 Request processed in 752us (901us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787758971.195935:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 44 00000100:00100000:3.0:1787758971.199462:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758971.199533:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062713472 00000100:00100000:2.0:1787758971.199543:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062713472 00000100:00100000:2.0:1787758971.199581:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:2.0:1787758971.199591:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:33089637-5953-4edf-8e89-39ecfabcd268+16:11802:x1874601062713472:12345-192.168.201.54@tcp:35:multiop.0 00000100:00100000:2.0:1787758971.199747:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:33089637-5953-4edf-8e89-39ecfabcd268+17:11802:x1874601062713472:12345-192.168.201.54@tcp:35:multiop.0 Request processed in 158us (287us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787758971.199753:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:3.0:1787758971.206381:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758971.206430:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062713600 00000100:00100000:0.0:1787758971.206436:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062713600 00000100:00100000:0.0:1787758971.206474:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 45 00000100:00100000:0.0:1787758971.206484:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+17:11803:x1874601062713600:12345-192.168.201.54@tcp:101:multiop.0 00010000:00010000:0.0:1787758971.206502:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758971.206522:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d604 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8826 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.206580:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d60b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.206595:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d60b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.206606:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d60b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787758971.206684:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787758971.206690:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787758971.206714:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d60b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.206739:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d604 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8826 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.206757:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d60b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8826 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.206782:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f100) 00010000:00010000:0.0:1787758971.206785:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787758971.206789:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf5d53400, rc 0) 00000100:00100000:0.0:1787758971.206852:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+18:11803:x1874601062713600:12345-192.168.201.54@tcp:101:multiop.0 Request processed in 368us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758971.206860:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 45 00000100:00100000:3.0:1787758971.208533:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758971.208578:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062713856 00000100:00100000:0.0:1787758971.208584:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062713856 00000100:00100000:0.0:1787758971.208642:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 46 00000100:00100000:0.0:1787758971.208653:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+18:11803:x1874601062713856:12345-192.168.201.54@tcp:101:multiop.0 00010000:00010000:0.0:1787758971.208663:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758971.208673:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d612 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea882d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.208728:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53200/0xa3b7f37aab2d619 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.208739:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53200/0xa3b7f37aab2d619 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.208748:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53200/0xa3b7f37aab2d619 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787758971.208758:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 163840 00010000:00010000:0.0:1787758971.208869:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d612 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea882d expref: 21 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.208897:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53200/0xa3b7f37aab2d619 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea882d expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.208906:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ccc705f800) 00010000:00010000:0.0:1787758971.208909:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787758971.208911:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf5d53200, rc 0) 00000100:00100000:0.0:1787758971.208947:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+20:11803:x1874601062713856:12345-192.168.201.54@tcp:101:multiop.0 Request processed in 297us (415us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787758971.208955:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 46 00000100:00100000:3.0:1787758971.220684:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758971.220735:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062714112 00000100:00100000:0.0:1787758971.220743:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062714112 00000100:00100000:0.0:1787758971.220787:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:0.0:1787758971.220809:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc5687c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+20:11804:x1874601062714112:12345-192.168.201.54@tcp:35:rm.0 00000100:00100000:0.0:1787758971.221027:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc5687c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+21:11804:x1874601062714112:12345-192.168.201.54@tcp:35:rm.0 Request processed in 231us (349us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787758971.221033:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:3.0:1787758971.222437:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758971.222491:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062714368 00000100:00100000:2.0:1787758971.222497:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062714368 00000100:00100000:2.0:1787758971.222535:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 47 00000100:00100000:2.0:1787758971.222544:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+21:11804:x1874601062714368:12345-192.168.201.54@tcp:36:rm.0 00010000:00010000:2.0:1787758971.222578:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787758971.222612:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17b200/0xa3b7f37aab2d5f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea881f expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.222666:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53200/0xa3b7f37aab2d619 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea882d expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.222680:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53a00/0xa3b7f37aab2d56a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea87fc expref: 19 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.222691:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ccc705f800) 00010000:00010000:2.0:1787758971.222707:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53400/0xa3b7f37aab2d60b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8826 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.222713:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f100) 00010000:00010000:2.0:1787758971.222718:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787758971.222736:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d627 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.222744:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d627 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.222750:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d627 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.222758:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d62e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.222763:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d62e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.222766:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d62e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.222886:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d635 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.222896:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d635 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.222905:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d635 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787758971.223464:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787758971.223475:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 121497858105ns, next at 122497855847ns, rc = 0 00010000:00010000:2.0:1787758971.223531:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4200/0xa3b7f37aab2d63c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.223542:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4200/0xa3b7f37aab2d63c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.223551:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4200/0xa3b7f37aab2d63c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.223559:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4200/0xa3b7f37aab2d63c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.223567:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4200/0xa3b7f37aab2d63c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.223575:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4200/0xa3b7f37aab2d63c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.223596:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787758971.223611:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d635 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.223640:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787758971.223654:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4200/0xa3b7f37aab2d63c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.223654:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d635 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.223677:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d635 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.223678:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d4200 already unused, calling callback (ffffffffc1666530) 00010000:00010000:0.0:1787758971.223688:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4200/0xa3b7f37aab2d63c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.223689:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d4c00 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:2.0:1787758971.223697:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d635 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.223702:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4200/0xa3b7f37aab2d63c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.223710:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d635 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.223729:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ccd83ee000) 00010000:00010000:2.0:1787758971.223734:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787758971.223738:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d635 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.223743:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99ccd83ee000) 00010000:00010000:2.0:1787758971.223746:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d635 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.223747:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787758971.223753:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4200/0xa3b7f37aab2d63c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.223761:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4200/0xa3b7f37aab2d63c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.223770:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d627 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.223774:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758971.223778:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758971.223780:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758971.223781:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d627 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.223790:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d627 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.223796:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d4400 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:2.0:1787758971.223807:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d627 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.223814:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d627 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.223839:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd83ee800) 00010000:00010000:2.0:1787758971.223842:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787758971.223846:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d627 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.223852:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d627 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787758971.223868:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6235cfe reply state 00000000c46ac19c transno 4294967321 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d62e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758971.223877:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787758971.223926:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+19:11804:x1874601062714368:12345-192.168.201.54@tcp:36:rm.0 Request processed in 1383us (1488us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787758971.223933:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 47 00010000:00010000:0.0:1787758971.224640:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d62e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.224650:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d62e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.224658:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d62e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.224664:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d4a00 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758971.224668:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d62e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.224675:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d62e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.224686:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa28e36b1 (ffff99ccd83eeb00) 00010000:00010000:0.0:1787758971.224689:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787758971.224693:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d62e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.224707:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4a00/0xa3b7f37aab2d62e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758971.230757:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758971.230844:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062714496 00000100:00100000:1.0:1787758971.230854:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062714496 00000100:00100000:1.0:1787758971.230905:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 48 00000100:00100000:1.0:1787758971.230915:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+18:11805:x1874601062714496:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:1.0:1787758971.230937:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758971.230957:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17ac00/0xa3b7f37aab2d643 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8834 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.231026:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d64a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.231039:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d64a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.231050:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d64a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787758971.231098:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787758971.231102:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787758971.231132:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d64a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.231155:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17ac00/0xa3b7f37aab2d643 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8834 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.231171:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d64a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8834 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.231180:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd9d5c500) 00010000:00010000:1.0:1787758971.231183:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787758971.231187:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccfd17aa00, rc 0) 00000100:00100000:1.0:1787758971.231238:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+19:11805:x1874601062714496:12345-192.168.201.54@tcp:101:dd.0 Request processed in 325us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758971.231253:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 48 00000100:00100000:3.0:1787758971.233131:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758971.233167:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062714752 00000100:00100000:0.0:1787758971.233173:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062714752 00000100:00100000:0.0:1787758971.233203:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 49 00000100:00100000:0.0:1787758971.233209:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+19:11805:x1874601062714752:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:0.0:1787758971.233218:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758971.233221:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787758971.233234:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d64a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8834 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.233244:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd9d5c500) 00010000:00010000:0.0:1787758971.233253:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787758971.233261:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d651 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea883b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.233325:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d658 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.233333:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d658 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.233338:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d658 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.233346:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53600/0xa3b7f37aab2d65f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.233362:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53600/0xa3b7f37aab2d65f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.233367:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53600/0xa3b7f37aab2d65f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787758971.233775:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787758971.233903:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52200/0xa3b7f37aab2d666 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.233910:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52200/0xa3b7f37aab2d666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.233916:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52200/0xa3b7f37aab2d666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.233938:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d658 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.233943:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d658 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.233948:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d658 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.233952:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf5d52600 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758971.233955:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d658 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.233959:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d658 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.233974:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f300) 00010000:00010000:0.0:1787758971.233976:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787758971.233979:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d658 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.233984:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d658 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787758971.233991:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089bc6ff0 reply state 000000000b2f1147 transno 4294967322 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53600/0xa3b7f37aab2d65f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787758971.233997:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787758971.234013:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d651 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea883b expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.234025:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52200/0xa3b7f37aab2d666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea883b expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.234030:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ccc705fe00) 00010000:00010000:0.0:1787758971.234032:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787758971.234033:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf5d52200, rc 0) 00000100:00100000:0.0:1787758971.234071:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+21:11805:x1874601062714752:12345-192.168.201.54@tcp:101:dd.0 Request processed in 862us (943us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787758971.234076:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 49 00010000:00010000:1.0:1787758971.234775:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53600/0xa3b7f37aab2d65f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.234808:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53600/0xa3b7f37aab2d65f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.234816:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53600/0xa3b7f37aab2d65f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.234839:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf5d53600 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:1.0:1787758971.234843:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53600/0xa3b7f37aab2d65f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.234852:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53600/0xa3b7f37aab2d65f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.234863:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa28e36b1 (ffff99ccc705fa00) 00010000:00010000:1.0:1787758971.234866:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758971.234870:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53600/0xa3b7f37aab2d65f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.234878:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53600/0xa3b7f37aab2d65f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758971.236509:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758971.236570:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062714880 00000100:00100000:1.0:1787758971.236577:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062714880 00000100:00100000:1.0:1787758971.236668:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00080000:3.0:1787758971.236670:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787758971.236682:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33089637-5953-4edf-8e89-39ecfabcd268+5:11805:x1874601062714880:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:1.0:1787758971.236698:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758971.236715:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a94fe0d/0xa3b7f37aab2d674 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8842 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787758971.236754:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787758971.236773:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=121s v=(0 0) 00010000:00010000:1.0:1787758971.236778:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787758971.236788:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a94fe0d/0xa3b7f37aab2d674 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8842 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.236806:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a94fe0d/0xa3b7f37aab2d674 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8842 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.236819:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccfd17a600, rc 0) 00000100:00100000:1.0:1787758971.236892:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33089637-5953-4edf-8e89-39ecfabcd268+6:11805:x1874601062714880:12345-192.168.201.54@tcp:101:dd.0 Request processed in 215us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758971.236899:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00100000:3.0:1787758971.247685:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758971.247738:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062715136 00000100:00100000:2.0:1787758971.247747:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062715136 00000100:00100000:2.0:1787758971.247792:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:2.0:1787758971.247804:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:33089637-5953-4edf-8e89-39ecfabcd268+20:11805:x1874601062715136:12345-192.168.201.54@tcp:35:dd.0 00000100:00100000:2.0:1787758971.248107:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:33089637-5953-4edf-8e89-39ecfabcd268+21:11805:x1874601062715136:12345-192.168.201.54@tcp:35:dd.0 Request processed in 305us (432us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787758971.248120:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:3.0:1787758971.269347:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758971.269421:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062715264 00000100:00100000:0.0:1787758971.269431:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062715264 00000100:00100000:0.0:1787758971.269498:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 50 00000100:00100000:0.0:1787758971.269509:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+21:11806:x1874601062715264:12345-192.168.201.54@tcp:101:multiop.0 00010000:00010000:0.0:1787758971.269550:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758971.269575:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d67b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8849 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.269672:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d682 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.269684:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.269693:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787758971.269746:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787758971.269749:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787758971.269767:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.269785:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d67b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8849 expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.269801:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d682 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8849 expref: 22 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.269810:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f300) 00010000:00010000:0.0:1787758971.269814:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787758971.269818:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf5d52600, rc 0) 00000100:00100000:0.0:1787758971.269889:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+22:11806:x1874601062715264:12345-192.168.201.54@tcp:101:multiop.0 Request processed in 383us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758971.269895:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 50 00000100:00100000:3.0:1787758971.271907:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758971.271942:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062715520 00000100:00100000:2.0:1787758971.271948:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062715520 00000100:00100000:2.0:1787758971.271987:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 51 00000100:00100000:2.0:1787758971.271994:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+22:11806:x1874601062715520:12345-192.168.201.54@tcp:101:multiop.0 00010000:00010000:2.0:1787758971.272004:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758971.272006:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787758971.272020:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52600/0xa3b7f37aab2d682 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8849 expref: 22 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.272030:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f300) 00010000:00010000:2.0:1787758971.272037:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787758971.272046:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d689 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8850 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.272098:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d690 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.272116:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52200/0xa3b7f37aab2d666 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea883b expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.272123:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d690 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.272147:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52200/0xa3b7f37aab2d666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea883b expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.272157:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52200/0xa3b7f37aab2d666 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea883b expref: 22 pid: 5822 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758971.272167:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56d9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874601069025280:192.168.201.54@tcp:104: 00000100:00100000:2.0:1787758971.272243:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd00ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787758971.273320:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56d9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1874601069025280:192.168.201.54@tcp:104: 00010000:00010000:2.0:1787758971.273341:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d690 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758971.273888:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758971.273946:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062715648 00000100:00100000:1.0:1787758971.273952:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062715648 00010000:00010000:1.0:1787758971.273978:0:6686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52200/0xa3b7f37aab2d666 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea883b expref: 23 pid: 5822 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758971.274013:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 29 00000100:00100000:1.0:1787758971.274023:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33089637-5953-4edf-8e89-39ecfabcd268+23:2356:x1874601062715648:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787758971.274048:0:6686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787758971.274055:0:6686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52200/0xa3b7f37aab2d666 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea883b expref: 23 pid: 5822 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.274067:0:6686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52200/0xa3b7f37aab2d666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea883b expref: 23 pid: 5822 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.274089:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52200/0xa3b7f37aab2d666 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea883b expref: 23 pid: 5822 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.274101:0:6686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ccc705fe00) 00010000:00010000:1.0:1787758971.274106:0:6686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d690 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.274114:0:6686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d690 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.274121:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d690 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.274150:0:6686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787758971.274170:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d690 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.274179:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d690 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758971.274188:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33089637-5953-4edf-8e89-39ecfabcd268+22:2356:x1874601062715648:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 165us (298us total) trans 0 rc 0/0 00000004:00200000:2.0:1787758971.274197:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 163840 00000100:00100000:1.0:1787758971.274200:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 29 00010000:00010000:2.0:1787758971.274326:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d689 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8850 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.274348:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d690 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8850 expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.274357:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ccc705fe00) 00010000:00010000:2.0:1787758971.274360:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787758971.274363:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc79d4c00, rc 0) 00000100:00100000:2.0:1787758971.274395:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+22:11806:x1874601062715520:12345-192.168.201.54@tcp:101:multiop.0 Request processed in 2401us (2488us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787758971.274403:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 51 00000100:00100000:3.0:1787758971.276493:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758971.276540:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062715776 00000100:00100000:1.0:1787758971.276546:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062715776 00000100:00100000:1.0:1787758971.276591:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 52 00000100:00100000:1.0:1787758971.276600:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+22:11806:x1874601062715776:12345-192.168.201.54@tcp:101:multiop.0 00010000:00010000:1.0:1787758971.276639:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758971.276654:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17ac00/0xa3b7f37aab2d69e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8857 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.276710:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d6a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.276734:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d690 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8850 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.276743:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d6a5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.276767:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d690 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8850 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.276779:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d690 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8850 expref: 23 pid: 5823 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758971.276803:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5d643c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5852:1874601069025408:192.168.201.54@tcp:104: 00000100:00100000:1.0:1787758971.276874:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccc68720c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787758971.278017:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5d643c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5852:1874601069025408:192.168.201.54@tcp:104: 00010000:00010000:1.0:1787758971.278033:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d6a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758971.278692:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758971.278731:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062715904 00000100:00100000:2.0:1787758971.278736:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062715904 00010000:00010000:2.0:1787758971.278754:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d690 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8850 expref: 24 pid: 5823 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758971.278795:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 30 00000100:00100000:2.0:1787758971.278805:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33089637-5953-4edf-8e89-39ecfabcd268+24:2356:x1874601062715904:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787758971.278817:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787758971.278838:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d690 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8850 expref: 24 pid: 5823 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.278851:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d690 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8850 expref: 24 pid: 5823 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.278870:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d690 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8850 expref: 24 pid: 5823 timeout: 221 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.278884:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ccc705fe00) 00010000:00010000:2.0:1787758971.278889:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d6a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.278898:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.278905:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d6a5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.278936:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787758971.278970:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33089637-5953-4edf-8e89-39ecfabcd268+23:2356:x1874601062715904:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 167us (277us total) trans 0 rc 0/0 00010000:00010000:1.0:1787758971.278974:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758971.278979:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 30 00010000:00010000:1.0:1787758971.278991:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787758971.279020:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 163840 00000004:00200000:1.0:1787758971.279026:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787758971.279045:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.279086:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17ac00/0xa3b7f37aab2d69e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8857 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.279103:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d6a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8857 expref: 22 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758971.279111:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ccc705fe00) 00010000:00010000:1.0:1787758971.279115:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787758971.279118:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccfd17aa00, rc 0) 00000100:00100000:1.0:1787758971.279154:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+22:11806:x1874601062715776:12345-192.168.201.54@tcp:101:multiop.0 Request processed in 2554us (2661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758971.279163:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 52 00000100:00100000:3.0:1787758971.282205:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758971.282259:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062716160 00000100:00100000:0.0:1787758971.282268:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062716160 00000100:00100000:0.0:1787758971.282315:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:0.0:1787758971.282323:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+22:11806:x1874601062716160:12345-192.168.201.54@tcp:35:multiop.0 00000100:00100000:0.0:1787758971.282503:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+23:11806:x1874601062716160:12345-192.168.201.54@tcp:35:multiop.0 Request processed in 180us (300us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787758971.282509:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:3.0:1787758971.290728:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758971.290777:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062716288 00000100:00100000:0.0:1787758971.290786:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062716288 00000100:00100000:0.0:1787758971.290846:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 53 00000100:00100000:0.0:1787758971.290859:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+23:11807:x1874601062716288:12345-192.168.201.54@tcp:101:multiop.0 00010000:00010000:0.0:1787758971.290885:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758971.290903:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d6ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea885e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.290975:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52400/0xa3b7f37aab2d6b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.290986:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52400/0xa3b7f37aab2d6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.290994:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52400/0xa3b7f37aab2d6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787758971.291041:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787758971.291045:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787758971.291081:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52400/0xa3b7f37aab2d6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.291105:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d6ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea885e expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.291125:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52400/0xa3b7f37aab2d6b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea885e expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.291132:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705fb00) 00010000:00010000:0.0:1787758971.291134:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787758971.291138:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf5d52400, rc 0) 00000100:00100000:0.0:1787758971.291181:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+24:11807:x1874601062716288:12345-192.168.201.54@tcp:101:multiop.0 Request processed in 327us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758971.291186:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 53 00000100:00100000:3.0:1787758971.293324:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758971.293358:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062716544 00000100:00100000:0.0:1787758971.293363:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062716544 00000100:00100000:0.0:1787758971.293389:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 54 00000100:00100000:0.0:1787758971.293395:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+24:11807:x1874601062716544:12345-192.168.201.54@tcp:101:multiop.0 00010000:00010000:0.0:1787758971.293403:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758971.293420:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52a00/0xa3b7f37aab2d6ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8865 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293455:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53c00/0xa3b7f37aab2d6c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293463:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53c00/0xa3b7f37aab2d6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293472:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53c00/0xa3b7f37aab2d6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293486:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52000/0xa3b7f37aab2d6c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293510:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52000/0xa3b7f37aab2d6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293519:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52000/0xa3b7f37aab2d6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293597:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52c00/0xa3b7f37aab2d6cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293607:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52c00/0xa3b7f37aab2d6cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293638:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52c00/0xa3b7f37aab2d6cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787758971.293649:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 163840 00010000:00010000:0.0:1787758971.293731:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53c00/0xa3b7f37aab2d6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293737:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53c00/0xa3b7f37aab2d6c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293742:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53c00/0xa3b7f37aab2d6c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293747:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf5d53c00 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758971.293751:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53c00/0xa3b7f37aab2d6c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293758:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53c00/0xa3b7f37aab2d6c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293779:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705fb00) 00010000:00010000:0.0:1787758971.293782:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787758971.293787:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53c00/0xa3b7f37aab2d6c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293795:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53c00/0xa3b7f37aab2d6c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293804:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52000/0xa3b7f37aab2d6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293817:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52000/0xa3b7f37aab2d6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293836:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52000/0xa3b7f37aab2d6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293840:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccf5d52000 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758971.293842:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52000/0xa3b7f37aab2d6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293846:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52000/0xa3b7f37aab2d6c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293851:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa28e36b1 (ffff99ccc705fd00) 00010000:00010000:0.0:1787758971.293853:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787758971.293855:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52000/0xa3b7f37aab2d6c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293859:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52000/0xa3b7f37aab2d6c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293894:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52a00/0xa3b7f37aab2d6ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8865 expref: 27 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293902:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52c00/0xa3b7f37aab2d6cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8865 expref: 26 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758971.293907:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ccc705fe00) 00010000:00010000:0.0:1787758971.293909:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787758971.293910:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf5d52c00, rc 0) 00000100:00100000:0.0:1787758971.293938:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+26:11807:x1874601062716544:12345-192.168.201.54@tcp:101:multiop.0 Request processed in 543us (615us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1787758971.293942:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 54 00000100:00100000:3.0:1787758971.296053:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758971.296099:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062716672 00000100:00100000:2.0:1787758971.296109:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062716672 00000100:00100000:2.0:1787758971.296140:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 2 00000100:00100000:2.0:1787758971.296146:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf57efc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33089637-5953-4edf-8e89-39ecfabcd268+26:2358:x1874601062716672:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787758971.296155:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787758971.296167:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52c00/0xa3b7f37aab2d6cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8865 expref: 26 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758971.296177:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ccc705fe00) 00010000:00010000:2.0:1787758971.296180:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787758971.296204:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf57efc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33089637-5953-4edf-8e89-39ecfabcd268+25:2358:x1874601062716672:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 59us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758971.296210:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 2 00000100:00100000:3.0:1787758971.298769:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758971.298806:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062716928 00000100:00100000:2.0:1787758971.298811:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062716928 00000100:00100000:2.0:1787758971.298852:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:2.0:1787758971.298859:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:33089637-5953-4edf-8e89-39ecfabcd268+25:11807:x1874601062716928:12345-192.168.201.54@tcp:35:multiop.0 00000100:00100000:2.0:1787758971.298991:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:33089637-5953-4edf-8e89-39ecfabcd268+26:11807:x1874601062716928:12345-192.168.201.54@tcp:35:multiop.0 Request processed in 133us (222us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1787758971.298997:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 13 00010000:00010000:2.0:1787758971.933145:0:7614:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787758972.572753:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601069025664:0@lo:400:kworker.0 00000100:00100000:1.0:1787758972.572771:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874601069025792:0@lo:400:kworker.0 00000100:00100000:0.0:1787758972.572830:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5d643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069025536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787758972.572854:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758972.572855:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758972.572888:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787758972.572916:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3293:1874601069026176:0@lo:400:kworker.0 00000100:00100000:1.0:1787758972.572927:0:3290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069026304:0@lo:400:kworker.0 00000100:00100000:2.0:1787758972.572929:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1874601069026048:0@lo:400:kworker.0 00000100:00100000:0.0:1787758972.572948:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758972.572979:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787758972.572988:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069025792 00000100:00100000:0.0:1787758972.572990:0:3291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf5ba70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3291:1874601069025920:0@lo:400:kworker.0 00000100:00100000:1.0:1787758972.572997:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069025792 00000100:00100000:0.0:1787758972.573030:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758972.573031:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069026048 00000100:00100000:2.0:1787758972.573036:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069026048 00000100:00100000:1.0:1787758972.573047:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069026176 00000100:00100000:1.0:1787758972.573050:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069026176 00000100:00100000:0.0:1787758972.573077:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069025664 00000100:00100000:0.0:1787758972.573083:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069025664 00000100:00100000:1.0:1787758972.573083:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069025920 00000100:00100000:2.0:1787758972.573088:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787758972.573089:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069025920 00000100:00100000:2.0:1787758972.573099:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf56d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1874601069026048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758972.573118:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787758972.573125:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1874601069025792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787758972.573131:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787758972.573141:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc746b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3292:x1874601069025664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758972.573161:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1874601069025792:12345-0@lo:400:kworker.0 Request processed in 35us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758972.573161:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf56d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1874601069026048:12345-0@lo:400:kworker.0 Request processed in 62us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758972.573171:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787758972.573171:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787758972.573194:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787758972.573204:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc746b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ac8ab81-7a8c-4750-ad68-6c8860af0f55+19:3292:x1874601069025664:12345-0@lo:400:kworker.0 Request processed in 63us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787758972.573204:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5ba4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874601069026176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787758972.573215:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787758972.573218:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3292:1874601069026048:0@lo:400:kworker.0 00000100:00100000:2.0:1787758972.573232:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ac8ab81-7a8c-4750-ad68-6c8860af0f55:3292:1874601069025664:0@lo:400:kworker.0 00000100:00100000:1.0:1787758972.573266:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5ba4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874601069026176:12345-0@lo:400:kworker.0 Request processed in 65us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758972.573274:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787758972.573290:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5ba43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874601069025920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787758972.573290:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1787758972.573292:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787758972.573313:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069025536 00000100:00100000:2.0:1787758972.573319:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069025536 00000100:00100000:1.0:1787758972.573331:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3293:1874601069026176:0@lo:400:kworker.0 00000100:00100000:0.0:1787758972.573342:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5ba43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1874601069025920:12345-0@lo:400:kworker.0 Request processed in 58us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758972.573350:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787758972.573363:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787758972.573367:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787758972.573372:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5ba6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1874601069025536:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787758972.573401:0:3291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3291:1874601069025920:0@lo:400:kworker.0 00002000:00000024:2.0:1787758972.573403:0:6672:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787758972.573408:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3290:1874601069025792:0@lo:400:kworker.0 00000100:00100000:0.0:1787758972.573434:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601069026304 00000100:00100000:0.0:1787758972.573438:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601069026304 00000100:00100000:0.0:1787758972.573467:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787758972.573473:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5ba6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1874601069025536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758972.573481:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf5d670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3290:x1874601069026304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787758972.573488:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1787758972.573512:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787758972.573516:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5d643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3293:1874601069025536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787758972.573528:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf5d670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3290:x1874601069026304:12345-0@lo:400:kworker.0 Request processed in 51us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758972.573534:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787758972.573549:0:3290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf5ba4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3290:1874601069026304:0@lo:400:kworker.0 00010000:00010000:0.0:1787758972.956715:0:6685:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758973.242032:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758973.242078:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062717184 00000100:00100000:2.0:1787758973.242089:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062717184 00000100:00100000:2.0:1787758973.242158:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 55 00000100:00080000:0.0:1787758973.242159:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787758973.242169:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+26:12224:x1874601062717184:12345-192.168.201.54@tcp:36:rm.0 00010000:00010000:2.0:1787758973.242234:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787758973.242262:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d6a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8857 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.242294:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ccc705fe00) 00010000:00010000:2.0:1787758973.242308:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52400/0xa3b7f37aab2d6b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea885e expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.242315:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705fb00) 00010000:00010000:2.0:1787758973.242320:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787758973.242340:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d6dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.242350:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d6dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.242357:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d6dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.242365:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d6e4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.242370:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d6e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.242374:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d6e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.243642:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d6eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.243654:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d6eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.243674:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d6eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787758973.245394:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1787758973.245406:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 123519789467ns, next at 124519786596ns, rc = 0 00010000:00010000:2.0:1787758973.245476:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5200/0xa3b7f37aab2d6f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245489:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5200/0xa3b7f37aab2d6f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245498:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5200/0xa3b7f37aab2d6f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245507:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5200/0xa3b7f37aab2d6f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245515:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5200/0xa3b7f37aab2d6f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245522:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5200/0xa3b7f37aab2d6f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245545:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787758973.245567:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d6eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245576:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d6eb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758973.245577:0:8427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787758973.245589:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5200/0xa3b7f37aab2d6f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245589:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d6eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758973.245599:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d5200 already unused, calling callback (ffffffffc1666530) 00010000:00010000:2.0:1787758973.245604:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d5600 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758973.245605:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5200/0xa3b7f37aab2d6f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245610:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d6eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758973.245643:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5200/0xa3b7f37aab2d6f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245643:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d6eb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758973.245669:0:8427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ccd83ee300) 00010000:00010000:0.0:1787758973.245673:0:8427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787758973.245682:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5200/0xa3b7f37aab2d6f2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245688:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99ccd83ee300) 00010000:00010000:0.0:1787758973.245689:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5200/0xa3b7f37aab2d6f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245698:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787758973.245704:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d6eb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758973.245706:0:8427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758973.245709:0:8427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787758973.245712:0:8427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787758973.245718:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d6eb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245742:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d6dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245750:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d6dd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245757:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d6dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245763:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d4c00 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:2.0:1787758973.245767:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d6dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245774:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d6dd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245803:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd83ee800) 00010000:00010000:2.0:1787758973.245805:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787758973.245808:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d6dd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758973.245812:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d6dd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787758973.245823:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adc12d3d reply state 0000000045c9f202 transno 4294967328 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d6e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758973.245830:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787758973.245897:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+26:12224:x1874601062717184:12345-192.168.201.54@tcp:36:rm.0 Request processed in 3730us (3875us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787758973.245904:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 55 00010000:00010000:0.0:1787758973.246751:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d6e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758973.246762:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d6e4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758973.246769:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d6e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758973.246776:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d4400 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758973.246779:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d6e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758973.246800:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d6e4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758973.246811:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa28e36b1 (ffff99ccd83eee00) 00010000:00010000:0.0:1787758973.246814:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787758973.246818:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d6e4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758973.246826:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4400/0xa3b7f37aab2d6e4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa28e36b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1787758973.938127:0:12163:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 460g: verify hole/data lseek or fiemap is disabled for compressed files on server ========================================================== 11:42:54 (1787758974) 00010000:00010000:1.0:1787758973.980864:0:8426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787758974.018803:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758974.018879:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062717312 00000100:00100000:0.0:1787758974.018893:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062717312 00000100:00100000:0.0:1787758974.018972:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 56 00000100:00100000:0.0:1787758974.018986:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+25:12380:x1874601062717312:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1787758974.019020:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758974.019049:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52e00/0xa3b7f37aab2d6f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea886c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.019129:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53e00/0xa3b7f37aab2d700 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.019147:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53e00/0xa3b7f37aab2d700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.019164:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53e00/0xa3b7f37aab2d700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787758974.019237:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787758974.019241:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787758974.019268:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53e00/0xa3b7f37aab2d700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.019294:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52e00/0xa3b7f37aab2d6f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea886c expref: 27 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.019313:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53e00/0xa3b7f37aab2d700 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea886c expref: 26 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.019323:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705fd00) 00010000:00010000:0.0:1787758974.019346:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787758974.019351:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf5d53e00, rc 0) 00000100:00100000:0.0:1787758974.019419:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+26:12380:x1874601062717312:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 436us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758974.019427:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 56 00000100:00100000:3.0:1787758974.021384:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758974.021458:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062717440 00000100:00100000:1.0:1787758974.021466:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062717440 00000100:00100000:1.0:1787758974.021507:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 57 00000100:00100000:1.0:1787758974.021516:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+26:12380:x1874601062717440:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:1.0:1787758974.021531:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758974.021548:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a200/0xa3b7f37aab2d707 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8873 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.021599:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d70e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.021612:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d70e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.021650:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d70e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.021824:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d715 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.021851:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.021867:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.021935:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d70e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.021940:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d70e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.021946:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d70e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.021950:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccfd17aa00 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:1.0:1787758974.021954:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d70e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.021960:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d70e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.021970:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705fd00) 00010000:00010000:1.0:1787758974.021973:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758974.021977:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d70e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.021981:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d70e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.022005:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.022009:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d715 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.022013:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d715 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.022016:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccfd17a400 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:1.0:1787758974.022018:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d715 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.022022:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d715 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.022027:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb9a33bcc (ffff99ccd9d5ce00) 00010000:00010000:1.0:1787758974.022028:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758974.022030:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d715 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.022034:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d715 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.022070:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a200/0xa3b7f37aab2d707 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8873 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.022077:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705fd00) 00010000:00010000:1.0:1787758974.022079:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758974.022081:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a200/0xa3b7f37aab2d707 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8873 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.022092:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccfd17a200, rc 0) 00000100:00100000:1.0:1787758974.022160:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+26:12380:x1874601062717440:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 645us (777us total) trans 0 rc 301/301 00000100:00100000:1.0:1787758974.022168:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 57 00000100:00100000:3.0:1787758974.024827:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758974.024891:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062717696 00000100:00100000:2.0:1787758974.024899:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062717696 00000100:00100000:2.0:1787758974.024936:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 58 00000100:00100000:2.0:1787758974.024943:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+26:12380:x1874601062717696:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1787758974.024957:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758974.024959:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787758974.024977:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53e00/0xa3b7f37aab2d700 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea886c expref: 26 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.024990:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705fd00) 00010000:00010000:2.0:1787758974.024998:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787758974.025009:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d71c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea887a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.025116:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d723 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.025125:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d723 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.025131:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d723 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.025139:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4600/0xa3b7f37aab2d72a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.025144:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4600/0xa3b7f37aab2d72a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.025148:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4600/0xa3b7f37aab2d72a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.025873:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5a00/0xa3b7f37aab2d731 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.025882:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5a00/0xa3b7f37aab2d731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.025889:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5a00/0xa3b7f37aab2d731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787758974.025901:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787758974.025931:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d723 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.025938:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d723 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.025952:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d723 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.025960:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d5600 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:2.0:1787758974.025964:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d723 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.025973:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d723 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.025982:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd83ee800) 00010000:00010000:2.0:1787758974.025985:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787758974.025990:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d723 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.025997:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d723 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787758974.026010:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8637106 reply state 000000002338aad9 transno 4294967329 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4600/0xa3b7f37aab2d72a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758974.026020:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787758974.026044:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4c00/0xa3b7f37aab2d71c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea887a expref: 28 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.026061:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5a00/0xa3b7f37aab2d731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea887a expref: 27 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.026069:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ccd83ee700) 00010000:00010000:2.0:1787758974.026072:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787758974.026080:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc79d5a00, rc 0) 00000100:00100000:2.0:1787758974.026142:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+28:12380:x1874601062717696:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 1199us (1321us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787758974.026150:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 58 00010000:00010000:1.0:1787758974.026931:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4600/0xa3b7f37aab2d72a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.026943:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4600/0xa3b7f37aab2d72a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.026948:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4600/0xa3b7f37aab2d72a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.026952:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d4600 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:1.0:1787758974.026955:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4600/0xa3b7f37aab2d72a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.026960:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4600/0xa3b7f37aab2d72a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.026971:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb9a33bcc (ffff99ccd83ee300) 00010000:00010000:1.0:1787758974.026974:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758974.026977:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4600/0xa3b7f37aab2d72a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.026981:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4600/0xa3b7f37aab2d72a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758974.028884:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758974.028932:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062717952 00000100:00100000:2.0:1787758974.028942:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062717952 00000100:00100000:2.0:1787758974.029003:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 59 00000100:00100000:2.0:1787758974.029015:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+27:12380:x1874601062717952:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1787758974.029038:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758974.029058:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d73f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8881 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.029149:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d746 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.029163:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5a00/0xa3b7f37aab2d731 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea887a expref: 28 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.029173:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d746 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.029214:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5a00/0xa3b7f37aab2d731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea887a expref: 28 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.029230:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5a00/0xa3b7f37aab2d731 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea887a expref: 28 pid: 5821 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758974.029245:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ccf56db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5852:1874601069026432:192.168.201.54@tcp:104: 00000100:00100000:2.0:1787758974.029339:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff99ccfd323840 going to sleep for 11 seconds 00000100:00100000:2.0:1787758974.031461:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ccf56db0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5852:1874601069026432:192.168.201.54@tcp:104: 00010000:00010000:2.0:1787758974.031484:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d746 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758974.032178:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758974.032220:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062718080 00000100:00100000:1.0:1787758974.032234:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062718080 00010000:00010000:1.0:1787758974.032267:0:6686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5a00/0xa3b7f37aab2d731 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea887a expref: 29 pid: 5821 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758974.032303:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 31 00000100:00100000:1.0:1787758974.032313:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc9722850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33089637-5953-4edf-8e89-39ecfabcd268+29:2359:x1874601062718080:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787758974.032327:0:6686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787758974.032334:0:6686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5a00/0xa3b7f37aab2d731 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea887a expref: 29 pid: 5821 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.032349:0:6686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5a00/0xa3b7f37aab2d731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea887a expref: 29 pid: 5821 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.032369:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5a00/0xa3b7f37aab2d731 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x4ab477154fea887a expref: 29 pid: 5821 timeout: 224 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.032384:0:6686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ccd83ee700) 00010000:00010000:1.0:1787758974.032389:0:6686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d746 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.032398:0:6686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d746 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.032406:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d746 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.032431:0:6686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787758974.032461:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d746 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.032471:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d746 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787758974.032487:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc9722850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33089637-5953-4edf-8e89-39ecfabcd268+28:2359:x1874601062718080:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 165us (298us total) trans 0 rc 0/0 00000004:00200000:2.0:1787758974.032490:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00100000:1.0:1787758974.032508:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 31 00000004:00080000:2.0:1787758974.032758:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787758974.032906:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d746 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.032914:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d746 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.032922:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d746 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.032929:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d5000 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:2.0:1787758974.032934:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d746 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.032942:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d746 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.032952:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ccd83ee700) 00010000:00010000:2.0:1787758974.032954:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787758974.032958:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d746 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.032974:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d746 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.033022:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d73f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8881 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.033031:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd83ee200) 00010000:00010000:2.0:1787758974.033034:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787758974.033038:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d73f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8881 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.033049:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc79d4800, rc 0) 00000100:00100000:2.0:1787758974.033081:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+27:12380:x1874601062717952:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 4070us (4202us total) trans 4294967330 rc 301/301 00000100:00100000:2.0:1787758974.033089:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 59 00000100:00100000:3.0:1787758974.035022:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758974.035083:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062718336 00000100:00100000:0.0:1787758974.035090:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062718336 00000100:00100000:0.0:1787758974.035127:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00100000:0.0:1787758974.035137:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+27:12380:x1874601062718336:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:0.0:1787758974.035782:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+28:12380:x1874601062718336:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 624us (744us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787758974.035798:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00100000:3.0:1787758974.036884:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758974.036933:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062718592 00000100:00100000:2.0:1787758974.036941:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062718592 00000100:00100000:2.0:1787758974.036977:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:2.0:1787758974.036983:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:33089637-5953-4edf-8e89-39ecfabcd268+28:12380:x1874601062718592:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:2.0:1787758974.037116:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:33089637-5953-4edf-8e89-39ecfabcd268+29:12380:x1874601062718592:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 132us (233us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787758974.037125:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:3.0:1787758974.044965:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758974.045035:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062718720 00000100:00100000:0.0:1787758974.045047:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062718720 00000100:00100000:0.0:1787758974.045106:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 60 00000100:00100000:0.0:1787758974.045114:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+29:12385:x1874601062718720:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:0.0:1787758974.045135:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758974.045155:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52e00/0xa3b7f37aab2d754 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8888 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.045240:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d75b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.045251:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.045262:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787758974.045337:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787758974.045342:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787758974.045368:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.045405:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52e00/0xa3b7f37aab2d754 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8888 expref: 31 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.045420:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d75b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8888 expref: 30 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.045427:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f200) 00010000:00010000:0.0:1787758974.045430:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787758974.045432:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf5d52800, rc 0) 00000100:00100000:0.0:1787758974.045484:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+30:12385:x1874601062718720:12345-192.168.201.54@tcp:101:dd.0 Request processed in 371us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758974.045492:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 60 00000100:00100000:3.0:1787758974.047715:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758974.047793:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062718976 00000100:00100000:1.0:1787758974.047802:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062718976 00000100:00100000:1.0:1787758974.047869:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 61 00000100:00100000:1.0:1787758974.047882:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+30:12385:x1874601062718976:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:1.0:1787758974.047900:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758974.047904:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787758974.047932:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52800/0xa3b7f37aab2d75b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8888 expref: 30 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.047951:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f200) 00010000:00010000:1.0:1787758974.047964:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787758974.047981:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a200/0xa3b7f37aab2d762 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea888f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048161:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d769 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048174:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d769 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048185:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d769 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048210:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d770 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048218:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d770 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048242:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d770 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048320:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17bc00/0xa3b7f37aab2d777 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048329:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17bc00/0xa3b7f37aab2d777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048337:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17bc00/0xa3b7f37aab2d777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787758974.048347:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787758974.048463:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d769 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048472:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d769 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048479:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d769 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048486:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccfd17a400 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:1.0:1787758974.048492:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d769 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048500:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d769 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048509:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd9d5ce00) 00010000:00010000:1.0:1787758974.048513:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758974.048523:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d769 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048530:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d769 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048541:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d770 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048547:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d770 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048553:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d770 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048558:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccfd17aa00 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:1.0:1787758974.048561:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d770 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048567:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d770 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048574:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb9a33bcc (ffff99ccd9d5c600) 00010000:00010000:1.0:1787758974.048576:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758974.048579:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d770 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048584:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d770 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048646:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a200/0xa3b7f37aab2d762 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea888f expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048674:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17bc00/0xa3b7f37aab2d777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea888f expref: 31 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.048681:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ccd9d5c800) 00010000:00010000:1.0:1787758974.048683:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787758974.048685:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccfd17bc00, rc 0) 00000100:00100000:1.0:1787758974.048740:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+31:12385:x1874601062718976:12345-192.168.201.54@tcp:101:dd.0 Request processed in 862us (1027us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1787758974.048747:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 61 00000100:00100000:3.0:1787758974.051091:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758974.051150:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062719232 00000100:00100000:2.0:1787758974.051159:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062719232 00000100:00100000:2.0:1787758974.051203:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 62 00000100:00100000:2.0:1787758974.051211:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+31:12385:x1874601062719232:12345-192.168.201.54@tcp:36:dd.0 00010000:00010000:2.0:1787758974.051255:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787758974.051271:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17bc00/0xa3b7f37aab2d777 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea888f expref: 31 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.051283:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ccd9d5c800) 00010000:00010000:2.0:1787758974.051290:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787758974.051476:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d785 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.051488:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.051495:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787758974.051548:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787758974.051565:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007126d5b1 reply state 0000000077206723 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758974.051571:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787758974.051666:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+33:12385:x1874601062719232:12345-192.168.201.54@tcp:36:dd.0 Request processed in 456us (582us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787758974.051672:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 62 00000020:00080000:2.0:1787758974.051675:0:5821:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787758974.052381:0:3276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.052400:0:3276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d785 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.052406:0:3276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d785 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.052410:0:3276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d4800 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:0.0:1787758974.052414:0:3276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d785 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.052431:0:3276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d785 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.052446:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ccd83ee200) 00010000:00010000:0.0:1787758974.052449:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787758974.052454:0:3276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d785 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.052461:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d4800/0xa3b7f37aab2d785 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758974.052890:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758974.052925:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062719360 00000100:00100000:2.0:1787758974.052930:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062719360 00000100:00100000:2.0:1787758974.052958:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 63 00000100:00100000:2.0:1787758974.052970:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+32:12385:x1874601062719360:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:2.0:1787758974.052983:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787758974.053004:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d78c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea8896 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.053041:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d78c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8896 expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.053053:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5000/0xa3b7f37aab2d78c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea8896 expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.053069:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ccd83ee700) 00010000:00010000:2.0:1787758974.053072:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787758974.053074:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc79d5000, rc 0) 00000100:00100000:2.0:1787758974.053099:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33089637-5953-4edf-8e89-39ecfabcd268+33:12385:x1874601062719360:12345-192.168.201.54@tcp:101:dd.0 Request processed in 132us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758974.053104:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 63 00000100:00100000:3.0:1787758974.054828:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758974.054869:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062719488 00000100:00100000:2.0:1787758974.054874:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062719488 00000100:00100000:2.0:1787758974.054920:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 18 00000100:00100000:2.0:1787758974.054926:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33089637-5953-4edf-8e89-39ecfabcd268+8:12385:x1874601062719488:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:2.0:1787758974.054934:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1787758974.054942:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787758974.054947:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfee25e8/0xa3b7f37aab2d793 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea889d expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787758974.054969:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787758974.054983:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=124s v=(0 0) 00010000:00010000:2.0:1787758974.054988:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787758974.054993:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfee25e8/0xa3b7f37aab2d793 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea889d expref: 9 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.055013:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dfee25e8/0xa3b7f37aab2d793 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea889d expref: 9 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.055021:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccc79d4c00, rc 0) 00000100:00100000:2.0:1787758974.055046:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33089637-5953-4edf-8e89-39ecfabcd268+9:12385:x1874601062719488:12345-192.168.201.54@tcp:101:dd.0 Request processed in 121us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787758974.055050:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 18 00000100:00100000:3.0:1787758974.056426:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758974.056469:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062719616 00000100:00100000:1.0:1787758974.056474:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062719616 00002000:00010000:1.0:1787758974.056496:0:6674:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1787758974.056500:0:6674:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccf59b8b40 with x1874601062719616 ext(0->18446744073709551615) 00002000:00010000:1.0:1787758974.056506:0:6674:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccf59b8b40. 00000100:00100000:1.0:1787758974.056530:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 2 00000100:00100000:1.0:1787758974.056538:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:33089637-5953-4edf-8e89-39ecfabcd268+9:2356:x1874601062719616:12345-192.168.201.54@tcp:10:dd.0 00002000:00010000:1.0:1787758974.056802:0:6674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787758974.056805:0:6674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787758975 00002000:00010000:1.0:1787758974.056807:0:6674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787758974.056809:0:6674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787758975 00002000:00010000:1.0:1787758974.056810:0:6674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787758974.056838:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:33089637-5953-4edf-8e89-39ecfabcd268+10:2356:x1874601062719616:12345-192.168.201.54@tcp:10:dd.0 Request processed in 302us (414us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787758974.056844:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 2 00002000:00010000:1.0:1787758974.056847:0:6674:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1787758974.056856:0:6674:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccf59b8b40 with x1874601062719616 ext(0->18446744073709551615) 00002000:00010000:1.0:1787758974.056863:0:6674:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccf59b8b40. 00000100:00100000:3.0:1787758974.062236:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758974.062278:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062719872 00000100:00100000:0.0:1787758974.062287:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062719872 00000100:00100000:0.0:1787758974.062336:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:0.0:1787758974.062346:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccc5685c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+33:12385:x1874601062719872:12345-192.168.201.54@tcp:35:dd.0 00000100:00100000:0.0:1787758974.062711:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccc5685c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33089637-5953-4edf-8e89-39ecfabcd268+34:12385:x1874601062719872:12345-192.168.201.54@tcp:35:dd.0 Request processed in 365us (482us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1787758974.062720:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:3.0:1787758974.070282:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1787758974.070353:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062720000 00000100:00100000:0.0:1787758974.070364:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062720000 00000100:00100000:0.0:1787758974.070422:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 64 00000100:00100000:0.0:1787758974.070432:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+34:12386:x1874601062720000:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:0.0:1787758974.070461:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787758974.070496:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52e00/0xa3b7f37aab2d79a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea88a4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.070574:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53c00/0xa3b7f37aab2d7a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.070605:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53c00/0xa3b7f37aab2d7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.070640:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53c00/0xa3b7f37aab2d7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787758974.070706:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787758974.070710:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787758974.070741:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53c00/0xa3b7f37aab2d7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.070789:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d52e00/0xa3b7f37aab2d79a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea88a4 expref: 36 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.070814:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53c00/0xa3b7f37aab2d7a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea88a4 expref: 35 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787758974.070825:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f900) 00010000:00010000:0.0:1787758974.070828:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787758974.070833:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccf5d53c00, rc 0) 00000100:00100000:0.0:1787758974.070893:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33089637-5953-4edf-8e89-39ecfabcd268+35:12386:x1874601062720000:12345-192.168.201.54@tcp:101:dd.0 Request processed in 463us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787758974.070901:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 64 00000100:00100000:3.0:1787758974.072877:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758974.072921:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062720256 00000100:00100000:1.0:1787758974.072928:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062720256 00000100:00100000:1.0:1787758974.072971:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 65 00000100:00100000:1.0:1787758974.072979:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+35:12386:x1874601062720256:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:1.0:1787758974.072988:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787758974.072991:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787758974.073006:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccf5d53c00/0xa3b7f37aab2d7a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea88a4 expref: 35 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073016:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccc705f900) 00010000:00010000:1.0:1787758974.073023:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787758974.073033:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a200/0xa3b7f37aab2d7a8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ab477154fea88ab expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073144:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d7af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073152:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d7af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073158:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d7af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073167:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d7b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073171:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073185:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073232:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17b200/0xa3b7f37aab2d7bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073237:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17b200/0xa3b7f37aab2d7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073241:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17b200/0xa3b7f37aab2d7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787758974.073247:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 65536 00010000:00010000:1.0:1787758974.073332:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d7af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073338:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d7af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073342:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d7af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073346:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccfd17aa00 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:1.0:1787758974.073350:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d7af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073355:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d7af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073360:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99ccd9d5ce00) 00010000:00010000:1.0:1787758974.073362:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758974.073370:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d7af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073374:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17aa00/0xa3b7f37aab2d7af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073381:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073386:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d7b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073389:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d7b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073392:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccfd17a400 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:1.0:1787758974.073394:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d7b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073397:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d7b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073400:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb9a33bcc (ffff99ccd9d5c600) 00010000:00010000:1.0:1787758974.073402:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758974.073403:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d7b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073407:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a400/0xa3b7f37aab2d7b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb9a33bcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073438:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17a200/0xa3b7f37aab2d7a8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea88ab expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073465:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17b200/0xa3b7f37aab2d7bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea88ab expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.073473:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ccd83ee700) 00010000:00010000:1.0:1787758974.073475:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787758974.073477:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ccfd17b200, rc 0) 00000100:00100000:1.0:1787758974.073508:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33089637-5953-4edf-8e89-39ecfabcd268+36:12386:x1874601062720256:12345-192.168.201.54@tcp:101:dd.0 Request processed in 531us (633us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1787758974.073513:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 65 00000100:00100000:3.0:1787758974.075232:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758974.075275:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062720512 00000100:00100000:2.0:1787758974.075281:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062720512 00000100:00100000:2.0:1787758974.075316:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 66 00000100:00100000:2.0:1787758974.075326:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+36:12386:x1874601062720512:12345-192.168.201.54@tcp:36:dd.0 00010000:00010000:2.0:1787758974.075367:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787758974.075377:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccfd17b200/0xa3b7f37aab2d7bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x4ab477154fea88ab expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.075387:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ccd83ee700) 00010000:00010000:2.0:1787758974.075390:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787758974.075538:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d7cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.075549:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d7cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787758974.075557:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d7cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787758974.075638:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:2.0:1787758974.075672:0:5821:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047171b84 reply state 000000005c097b69 transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d7cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787758974.075680:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787758974.075728:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33089637-5953-4edf-8e89-39ecfabcd268+38:12386:x1874601062720512:12345-192.168.201.54@tcp:36:dd.0 Request processed in 405us (496us total) trans 4294967339 rc 0/0 00000100:00100000:2.0:1787758974.075738:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 66 00000020:00080000:2.0:1787758974.075741:0:5821:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787758974.076462:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d7cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.076470:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d7cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.076476:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d7cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.076481:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ccc79d5600 already unused, calling callback (ffffffffc20854f0) 00010000:00010000:1.0:1787758974.076485:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d7cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.076491:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d7cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.076501:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99ccd83ee700) 00010000:00010000:1.0:1787758974.076504:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787758974.076508:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d7cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787758974.076520:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ccc79d5600/0xa3b7f37aab2d7cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787758974.077411:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758974.077450:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062720640 00000100:00100000:1.0:1787758974.077454:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062720640 00002000:00010000:1.0:1787758974.077476:0:6676:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (98304->18446744073709551615) 00002000:00100000:1.0:1787758974.077481:0:6676:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccf59bb480 with x1874601062720640 ext(98304->18446744073709551615) 00002000:00010000:1.0:1787758974.077492:0:6676:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccf59bb480. 00000100:00100000:1.0:1787758974.077519:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 3 00000100:00100000:1.0:1787758974.077528:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:33089637-5953-4edf-8e89-39ecfabcd268+10:2357:x1874601062720640:12345-192.168.201.54@tcp:10:dd.0 00002000:00010000:1.0:1787758974.077686:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 98304 00002000:00010000:1.0:1787758974.077689:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787758975 -> 1787758975 00002000:00010000:1.0:1787758974.077691:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787758974.077693:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787758975 -> 1787758975 00002000:00010000:1.0:1787758974.077694:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787758974.077719:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:33089637-5953-4edf-8e89-39ecfabcd268+11:2357:x1874601062720640:12345-192.168.201.54@tcp:10:dd.0 Request processed in 194us (310us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787758974.077723:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 3 00002000:00010000:1.0:1787758974.077726:0:6676:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (98304->18446744073709551615) 00002000:00100000:1.0:1787758974.077728:0:6676:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccf59bb480 with x1874601062720640 ext(98304->18446744073709551615) 00002000:00010000:1.0:1787758974.077731:0:6676:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccf59bb480. 00000100:00100000:3.0:1787758974.081527:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1787758974.081571:0:11978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062720896 00000100:00100000:2.0:1787758974.081577:0:11978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062720896 00000100:00100000:2.0:1787758974.081612:0:11978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00100000:2.0:1787758974.081643:0:11978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:33089637-5953-4edf-8e89-39ecfabcd268+37:12386:x1874601062720896:12345-192.168.201.54@tcp:35:dd.0 00000100:00100000:2.0:1787758974.081854:0:11978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ccf59b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:33089637-5953-4edf-8e89-39ecfabcd268+38:12386:x1874601062720896:12345-192.168.201.54@tcp:35:dd.0 Request processed in 213us (335us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787758974.081860:0:11978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00100000:3.0:1787758974.105467:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1787758974.105535:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601062721024 00000100:00100000:1.0:1787758974.105547:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601062721024 00002000:00100000:1.0:1787758974.105611:0:6674:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->131071) req@ffff99ccf59b8000 x1874601062721024/t0(0) o4->33089637-5953-4edf-8e89-39ecfabcd268@192.168.201.54@tcp:525/0 lens 504/0 e 0 to 0 dl 1787758985 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787758974.105657:0:6674:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff99ccf59b8000 with x1874601062721024 ext(0->131071) 00002000:00010000:1.0:1787758974.105663:0:6674:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99ccf59b8000 00000100:00100000:1.0:1787758974.105695:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:1.0:1787758974.105703:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ccf59b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:33089637-5953-4edf-8e89-39ecfabcd268+11:2358:x1874601062721024:12345-192.168.201.54@tcp:4:dd.0 00002000:00040000:1.0:1787758974.105916:0:6674:0:(ofd_compress.c:1219:ofd_decompress_chunk()) ASSERTION( srcpages > 0 ) failed: chunk 65536 00002000:00040000:1.0:1787758974.108475:0:6674:0:(ofd_compress.c:1219:ofd_decompress_chunk()) LBUG Debug log: 9117 lines, 9117 kept, 0 dropped, 0 bad.